-- Logs begin at Mon 2022-04-18 19:11:29 UTC, end at Mon 2022-04-18 22:18:01 UTC. -- Apr 18 20:08:30.462521 n-d-838332-2 systemd[1]: Started Devstack devstack@n-super-cond.service. Apr 18 20:08:33.762332 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_db.sqlalchemy.engines [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:08:33.981320 n-d-838332-2 nova-conductor[94100]: DEBUG nova.context [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) {{(pid=94100) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:08:33.984982 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_concurrency.lockutils [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:08:33.986525 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_concurrency.lockutils [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:08:33.987374 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_concurrency.lockutils [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:08:33.989446 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_concurrency.lockutils [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:08:34.017666 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_db.sqlalchemy.engines [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:08:34.021393 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_db.sqlalchemy.engines [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:08:34.033382 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_concurrency.lockutils [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Acquired lock "singleton_lock" {{(pid=94100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 18 20:08:34.034009 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_concurrency.lockutils [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Releasing lock "singleton_lock" {{(pid=94100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 18 20:08:34.034799 n-d-838332-2 nova-conductor[94100]: INFO oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Starting 2 workers Apr 18 20:08:34.039550 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Started child 94973 {{(pid=94100) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Apr 18 20:08:34.043988 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Started child 94974 {{(pid=94100) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Apr 18 20:08:34.045181 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Full set of CONF: {{(pid=94100) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Apr 18 20:08:34.045613 n-d-838332-2 nova-conductor[94973]: INFO nova.service [-] Starting conductor node (version 23.2.1) Apr 18 20:08:34.046113 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ******************************************************************************** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:08:34.046113 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] Configuration options gathered from: {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:08:34.046535 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:08:34.047579 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] config files: ['/etc/nova/nova.conf'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:08:34.047981 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ================================================================================ {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:08:34.048801 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] allow_resize_to_same_host = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.049324 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] arq_binding_timeout = 300 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.049839 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] block_device_allocate_retries = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.050357 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] block_device_allocate_retries_interval = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.050921 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cert = self.pem {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.051479 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute_driver = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.058247 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute_monitors = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.058857 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] config_dir = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.059471 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] config_drive_format = iso9660 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.059845 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.060372 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] config_source = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.060870 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] console_host = n-d-838332-2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.061420 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] control_exchange = nova {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.062026 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cpu_allocation_ratio = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.062371 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] daemon = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.062906 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] debug = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.063400 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] default_access_ip_network_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.066447 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] default_availability_zone = nova {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.066447 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] default_ephemeral_format = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.066447 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.066934 n-d-838332-2 nova-conductor[94974]: INFO nova.service [-] Starting conductor node (version 23.2.1) Apr 18 20:08:34.068208 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] default_schedule_zone = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.069616 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] disk_allocation_ratio = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.071255 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] enable_new_services = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.072657 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] enabled_apis = ['osapi_compute'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.073733 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] enabled_ssl_apis = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.077110 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] flat_injected = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.077677 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] force_config_drive = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.078468 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] force_raw_images = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.078994 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] graceful_shutdown_timeout = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.086778 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] heal_instance_info_cache_interval = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.087306 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_db.sqlalchemy.engines [None req-ab879208-7c43-40bf-bdce-efeb899511aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:08:34.087425 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] host = n-d-838332-2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.088062 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.089341 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] initial_disk_allocation_ratio = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.089847 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] initial_ram_allocation_ratio = 1.5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.090504 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.091043 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_build_timeout = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.091465 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_delete_interval = 300 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.091982 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_format = [instance: %(uuid)s] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.092459 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_name_template = instance-%08x {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.092956 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_usage_audit = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.093490 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_usage_audit_period = month {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.093965 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.094466 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] instances_path = /opt/stack/data/nova/instances {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.095751 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] internal_service_availability_zone = internal {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.096523 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] key = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.097710 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] live_migration_retry_count = 30 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.099028 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_config_append = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.104888 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.107554 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_dir = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.109082 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.110174 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_options = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.111332 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_rotate_interval = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.112523 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_rotate_interval_type = days {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.117046 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] log_rotation_type = none {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.117537 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.117994 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.118510 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.119355 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.119776 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.121459 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] long_rpc_timeout = 1800 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.121966 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] max_concurrent_builds = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.123624 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] max_concurrent_live_migrations = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.124224 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] max_concurrent_snapshots = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.124605 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] max_local_block_devices = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.125212 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] max_logfile_count = 30 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.127581 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] max_logfile_size_mb = 200 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.127581 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] maximum_instance_delete_attempts = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.127581 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metadata_listen = 0.0.0.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.127581 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metadata_listen_port = 8775 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.127581 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metadata_workers = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134374 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] migrate_max_retries = -1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134374 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] mkisofs_cmd = genisoimage {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134374 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] my_block_storage_ip = 10.222.0.20 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134658 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_db.sqlalchemy.engines [None req-d31b7959-9975-4a89-b255-da505ba3d5e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] my_ip = 10.222.0.20 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] network_allocate_retries = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] osapi_compute_listen = 0.0.0.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] osapi_compute_listen_port = 8774 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] osapi_compute_unique_server_name_scope = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.134758 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] osapi_compute_workers = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.135300 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] password_length = 12 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.135300 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] periodic_enable = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.135300 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] periodic_fuzzy_delay = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.135300 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] pointer_model = usbtablet {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.135300 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] preallocate_images = none {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.135300 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] publish_errors = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.136432 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] pybasedir = /opt/stack/nova {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.136951 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ram_allocation_ratio = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.137459 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rate_limit_burst = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.137974 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rate_limit_except_level = CRITICAL {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.138454 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rate_limit_interval = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.138939 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] reboot_timeout = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.139737 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] reclaim_instance_interval = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.140205 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] record = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.140693 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] report_interval = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.141311 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rescue_timeout = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.141689 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] reserved_host_cpus = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.142182 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] reserved_host_disk_mb = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.142677 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] reserved_host_memory_mb = 512 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.143226 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] reserved_huge_pages = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.143699 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] resize_confirm_window = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.144167 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] resize_fs_using_block_device = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.144644 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] resume_guests_state_on_host_boot = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.145151 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.145721 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rpc_response_timeout = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.146242 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] run_external_periodic_tasks = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.147193 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] running_deleted_instance_action = reap {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.147416 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] running_deleted_instance_poll_interval = 1800 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.147881 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] running_deleted_instance_timeout = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.148369 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler_instance_sync_interval = 120 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.148831 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_down_time = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.149331 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] servicegroup_driver = db {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.150210 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] shelved_offload_time = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.150606 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] shelved_poll_interval = 3600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.151176 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] shutdown_timeout = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.152206 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] source_is_ipv6 = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.152677 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ssl_only = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.153153 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] state_path = /opt/stack/data/nova {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.153676 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] sync_power_state_interval = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.154134 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] sync_power_state_pool_size = 1000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.154627 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] syslog_log_facility = LOG_USER {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.155103 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] tempdir = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.155594 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] timeout_nbd = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.156106 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] transport_url = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.156723 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] update_resources_interval = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.157213 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_cow_images = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.157682 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_eventlog = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.158306 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_journal = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.158664 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_json = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.159148 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_rootwrap_daemon = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.159642 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_stderr = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.160374 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] use_syslog = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.160826 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vcpu_pin_set = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.161309 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vif_plugging_is_fatal = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.161789 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vif_plugging_timeout = 300 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.162334 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] virt_mkfs = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.162805 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] volume_usage_poll_interval = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.163322 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] watch_log_file = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.163822 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] web = /usr/share/spice-html5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:08:34.164449 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_concurrency.disable_process_locking = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.164952 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.165554 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.auth_strategy = keystone {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.166065 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.compute_link_prefix = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.166570 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.167330 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.dhcp_domain = novalocal {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.167940 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.enable_instance_password = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.168270 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.glance_link_prefix = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.168801 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.169241 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.169730 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.instance_list_per_project_cells = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.170394 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.list_records_by_skipping_down_cells = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.170827 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.local_metadata_per_cell = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.171332 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.max_limit = 1000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.metadata_cache_expiration = 15 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.neutron_default_tenant_id = default {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.use_forwarded_for = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.use_neutron_default_nets = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.174952 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.175506 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_dynamic_targets = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.175934 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_jsonfile_path = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.176433 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.177158 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.backend = dogpile.cache.memcached {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.177655 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.backend_argument = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.178146 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.config_prefix = cache.oslo {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.178649 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.dead_timeout = 60.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.179163 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.debug_cache_backend = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.179656 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.enable_retry_client = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.180136 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.enable_socket_keepalive = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.180726 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.enabled = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.181215 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.expiration_time = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.181693 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.hashclient_retry_attempts = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.182183 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.hashclient_retry_delay = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.182728 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_dead_retry = 300 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.183241 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.183714 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.184188 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_pool_maxsize = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.184666 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.185176 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.185654 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.memcache_socket_timeout = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.186146 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.proxies = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.186619 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.retry_attempts = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.187240 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.retry_delay = 0.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.187736 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.socket_keepalive_count = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.188230 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.socket_keepalive_idle = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.188712 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.socket_keepalive_interval = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.189177 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.tls_allowed_ciphers = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.189656 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.tls_cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.190134 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.tls_certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.190638 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.tls_enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.191352 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cache.tls_keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.191692 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.auth_section = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.192216 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.auth_type = password {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.192705 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.193312 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.catalog_info = volumev3::publicURL {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.193817 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.194294 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.194779 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.cross_az_attach = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.195278 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.endpoint_template = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.195536 n-d-838332-2 nova-conductor[94973]: DEBUG nova.service [None req-ab879208-7c43-40bf-bdce-efeb899511aa None None] Creating RPC server for service conductor {{(pid=94973) start /opt/stack/nova/nova/service.py:182}} Apr 18 20:08:34.196117 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.http_retries = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.196589 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.197057 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.197621 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.os_region_name = RegionOne {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.198661 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.199181 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cinder.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.cpu_dedicated_set = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.cpu_shared_set = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.image_type_exclude_list = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.max_concurrent_disk_ops = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.205678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.max_disk_devices_to_attach = -1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.resource_provider_association_refresh = 300 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] compute.shutdown_retry_interval = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] conductor.workers = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] console.allowed_origins = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] console.ssl_ciphers = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206184 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] console.ssl_minimum_version = default {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206629 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] consoleauth.token_ttl = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206629 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.206629 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.207215 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.207760 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.connect_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.208252 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.connect_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.208724 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.endpoint_override = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.209202 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.209669 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.210156 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.max_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.210628 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.min_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.211111 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.region_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.211589 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.service_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.212138 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.service_type = accelerator {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.212615 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.213085 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.status_code_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.214255 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.status_code_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.214846 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.215493 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.216086 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] cyborg.version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.216714 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.connection = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.217341 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.connection_debug = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.218031 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.connection_parameters = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.218622 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.connection_recycle_time = 3600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.219317 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.connection_trace = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.219917 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.max_overflow = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.220487 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.max_pool_size = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.221076 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.max_retries = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.221664 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.222248 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.pool_timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.222846 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.retry_interval = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.223450 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.slave_connection = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.224038 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] api_database.sqlite_synchronous = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.224621 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] devices.enabled_vgpu_types = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.225275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.226086 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ephemeral_storage_encryption.enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.226487 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.226905 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.api_servers = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.227305 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.227752 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.228117 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.228507 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.connect_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.229054 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.connect_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.229872 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.debug = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.230263 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.default_trusted_certificate_ids = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.230641 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.enable_certificate_validation = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.231018 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.enable_rbd_download = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.231414 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.endpoint_override = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.max_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.min_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.num_retries = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.rbd_ceph_conf = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234275 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.rbd_connect_timeout = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234701 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.rbd_pool = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.234777 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.rbd_user = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.235098 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.region_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.235952 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.service_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.236491 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.service_type = image {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.237017 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.237529 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.status_code_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.238058 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.status_code_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.238558 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.239132 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.239678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.verify_glance_signatures = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.240189 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] glance.version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.240764 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] guestfs.debug = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.241345 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.config_drive_cdrom = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.241724 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.config_drive_inject_password = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.242108 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.242506 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.enable_instance_metrics_collection = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.242883 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.enable_remotefx = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.243286 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.instances_path_share = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.243666 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.iscsi_initiator_list = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.244039 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.limit_cpu_features = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.244417 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.244817 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.245200 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.power_state_check_timeframe = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.245571 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.246004 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.246380 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.use_multipath_io = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.246750 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.volume_attach_retry_count = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.247143 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.247674 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.vswitch_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.248070 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.248476 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] mks.enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.249576 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.249965 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] image_cache.manager_interval = 2400 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.250355 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] image_cache.precache_concurrency = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.250726 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] image_cache.remove_unused_base_images = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.251288 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.251816 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.252358 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] image_cache.subdirectory_name = _base {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.252950 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.api_max_retries = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.253482 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.api_retry_interval = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.254046 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.auth_section = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.254571 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.auth_type = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.255106 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.255612 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.256145 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.256667 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.connect_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.257175 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.connect_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.257680 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.endpoint_override = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.258207 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.258724 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.259251 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.max_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.259866 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.min_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.260927 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.partition_key = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.261052 n-d-838332-2 nova-conductor[94974]: DEBUG nova.service [None req-d31b7959-9975-4a89-b255-da505ba3d5e9 None None] Creating RPC server for service conductor {{(pid=94974) start /opt/stack/nova/nova/service.py:182}} Apr 18 20:08:34.261563 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.peer_list = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.262073 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.region_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.262580 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.serial_console_state_timeout = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.263133 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.service_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.263701 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.service_type = baremetal {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.264223 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.264749 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.status_code_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.265260 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.status_code_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.265768 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.266322 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.266837 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ironic.version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.267452 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.268021 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] key_manager.fixed_key = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.268616 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.269133 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.barbican_api_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.269657 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.barbican_endpoint = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.270202 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.barbican_endpoint_type = public {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.270746 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.271280 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.271792 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.272316 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.272819 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.273375 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.number_of_retries = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.273886 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.retry_delay = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.274399 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.274913 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.275483 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.verify_ssl = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.276053 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] barbican.verify_ssl_path = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.277111 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.approle_role_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.277619 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.approle_secret_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.278138 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.278643 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.279222 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.279756 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.280263 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.280809 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.kv_mountpoint = secret {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.281323 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.kv_version = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.281839 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.root_token_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.282364 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.282890 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.ssl_ca_crt_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.283453 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.283963 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.use_ssl = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.284517 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.285053 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.285596 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.286127 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.286651 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.connect_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.287210 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.connect_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.287716 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.endpoint_override = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.288247 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.288755 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.289268 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.max_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.289786 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.min_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.290291 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.region_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.290810 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.service_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.291377 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.service_type = identity {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.291932 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.292304 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.status_code_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.292685 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.status_code_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.293062 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.293474 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.293841 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] keystone.version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.294318 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.connection_uri = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.294705 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.cpu_mode = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.295137 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.cpu_model_extra_flags = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.295568 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.cpu_models = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.295973 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.device_detach_attempts = 8 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.296381 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.device_detach_timeout = 20 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.296735 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.disk_cachemodes = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.298017 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.disk_prefix = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.302456 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.enabled_perf_events = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.303192 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.file_backed_memory = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.304187 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.gid_maps = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.304301 n-d-838332-2 nova-conductor[94973]: DEBUG nova.service [None req-ab879208-7c43-40bf-bdce-efeb899511aa None None] Join ServiceGroup membership for this service conductor {{(pid=94973) start /opt/stack/nova/nova/service.py:199}} Apr 18 20:08:34.304822 n-d-838332-2 nova-conductor[94973]: DEBUG nova.servicegroup.drivers.db [None req-ab879208-7c43-40bf-bdce-efeb899511aa None None] DB_Driver: join new ServiceGroup member n-d-838332-2 to the conductor group, service = {{(pid=94973) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 18 20:08:34.305085 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.hw_disk_discard = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.306151 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.hw_machine_type = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.307231 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_rbd_ceph_conf = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.308311 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.309308 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.311209 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_rbd_glance_store_name = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.313790 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_rbd_pool = rbd {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.315764 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_type = default {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.316164 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.images_volume_group = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.316564 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.inject_key = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.316952 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.inject_partition = -2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.317360 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.inject_password = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.317738 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.iscsi_iface = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.318115 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.iser_use_multipath = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.318498 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_bandwidth = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.318881 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.319793 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_downtime = 500 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.321480 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.321878 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.322795 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_inbound_addr = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.323773 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.324173 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_permit_post_copy = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.324504 n-d-838332-2 nova-conductor[94974]: DEBUG nova.service [None req-d31b7959-9975-4a89-b255-da505ba3d5e9 None None] Join ServiceGroup membership for this service conductor {{(pid=94974) start /opt/stack/nova/nova/service.py:199}} Apr 18 20:08:34.324616 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_scheme = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.324980 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_timeout_action = abort {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.325384 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_tunnelled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.325733 n-d-838332-2 nova-conductor[94974]: DEBUG nova.servicegroup.drivers.db [None req-d31b7959-9975-4a89-b255-da505ba3d5e9 None None] DB_Driver: join new ServiceGroup member n-d-838332-2 to the conductor group, service = {{(pid=94974) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Apr 18 20:08:34.325846 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_uri = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.326129 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.live_migration_with_native_tls = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.326502 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.max_queues = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.326876 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.328486 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.nfs_mount_options = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.329017 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.329398 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.329784 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.num_iser_scan_tries = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.330158 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.num_memory_encrypted_guests = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.330558 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.330938 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.num_pcie_ports = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.331350 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.num_volume_scan_tries = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.331774 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.pmem_namespaces = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.332179 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.quobyte_client_cfg = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.332645 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.333020 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rbd_connect_timeout = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.333396 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.333770 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.334142 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rbd_secret_uuid = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.334512 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rbd_user = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.334881 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.335296 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.remote_filesystem_transport = ssh {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.335685 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rescue_image_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.336055 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rescue_kernel_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.336418 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rescue_ramdisk_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.336810 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.337181 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.rx_queue_size = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.337569 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.smbfs_mount_options = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.338039 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.338417 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.snapshot_compression = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.338833 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.snapshot_image_format = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.339329 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.339711 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.sparse_logical_volumes = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.340084 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.swtpm_enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.340487 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.swtpm_group = tss {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.340871 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.swtpm_user = tss {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.341260 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.sysinfo_serial = unique {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.341627 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.tx_queue_size = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.342007 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.uid_maps = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.342377 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.use_virtio_for_bridges = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.342759 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.virt_type = kvm {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.343164 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.volume_clear = zero {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.343550 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.volume_clear_size = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.343939 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.volume_use_multipath = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.344313 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_cache_path = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.344704 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.345089 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_mount_group = qemu {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.345467 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_mount_opts = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.345853 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.346330 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.346719 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.vzstorage_mount_user = stack {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.347147 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.347571 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.auth_section = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.347958 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.auth_type = password {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.348325 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.348690 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.349070 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.349454 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.connect_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.349824 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.connect_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.350216 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.default_floating_pool = public {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.350591 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.endpoint_override = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.350961 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.extension_sync_interval = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.351359 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.http_retries = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.351738 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.352101 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.352469 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.max_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.352857 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.353220 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.min_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.353603 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.ovs_bridge = br-int {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.353985 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.physnets = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.354425 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.region_name = RegionOne {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.354813 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.service_metadata_proxy = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.355206 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.service_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.355599 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.service_type = network {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.355970 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.356339 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.status_code_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.356703 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.status_code_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.357064 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.357471 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.357854 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] neutron.version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.358239 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] notifications.bdms_in_notifications = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.358630 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] notifications.default_level = INFO {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.359036 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] notifications.notification_format = unversioned {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.359418 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] notifications.notify_on_state_change = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.359809 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.360240 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] pci.alias = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.360569 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] pci.passthrough_whitelist = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.360979 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.auth_section = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.361366 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.auth_type = password {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.361767 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.auth_url = http://10.222.0.20/identity {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.362138 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.362501 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.362876 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.363271 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.connect_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.363641 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.connect_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.364019 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.default_domain_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.364386 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.default_domain_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.364751 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.domain_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.365117 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.domain_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.365478 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.endpoint_override = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.365846 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.366208 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.366576 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.max_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.366939 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.min_version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.367340 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.password = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.367724 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.project_domain_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.368102 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.project_domain_name = Default {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.368485 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.project_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.368880 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.project_name = service {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.369264 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.region_name = RegionOne {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.369633 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.service_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.370565 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.service_type = placement {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.370941 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.371332 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.status_code_retries = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.371703 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.status_code_retry_delay = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.372071 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.system_scope = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.372436 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.372804 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.trust_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.373170 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.user_domain_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.373547 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.user_domain_name = Default {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.373915 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.user_id = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.374299 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.username = placement {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.374697 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.375181 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] placement.version = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.375524 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] powervm.disk_driver = localdisk {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.375904 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] powervm.proc_units_factor = 0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.376284 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] powervm.volume_group_name = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.376678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.cores = 20 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.377051 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.count_usage_from_placement = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.377433 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.377827 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.injected_file_content_bytes = 10240 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.378204 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.injected_file_path_length = 255 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.378574 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.injected_files = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.378950 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.instances = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.379422 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.key_pairs = 100 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.379793 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.metadata_items = 128 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.380163 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.ram = 51200 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.380566 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.recheck_quota = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.380905 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.server_group_members = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.381283 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] quota.server_groups = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.381661 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rdp.enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.382312 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.382726 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.383125 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.383499 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.image_metadata_prefilter = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.383875 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.384252 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.max_attempts = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.384624 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.max_placement_results = 1000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.385000 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.385401 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.query_placement_for_availability_zone = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.386326 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.query_placement_for_image_type_support = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.386696 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.387114 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] scheduler.workers = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.387514 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.387905 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.388385 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.388713 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.389086 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.389461 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.389844 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.390418 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.390813 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.host_subset_size = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.391212 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.391618 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.391974 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.isolated_hosts = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.392375 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.isolated_images = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.392781 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.393198 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.393548 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.393934 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.394309 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.394677 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.395105 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.395620 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.396062 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.track_instance_changes = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.396502 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.396914 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metrics.required = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.397318 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metrics.weight_multiplier = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.397722 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.398128 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] metrics.weight_setting = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.398734 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.399161 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] serial_console.enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.399605 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] serial_console.port_range = 10000:20000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.400022 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.400439 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.400865 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] serial_console.serialproxy_port = 6083 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.401305 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.auth_section = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.401719 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.auth_type = password {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.402117 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.402512 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.402915 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.403338 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.403781 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.404151 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.send_service_user_token = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.404554 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.404949 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] service_user.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.405404 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.agent_enabled = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.405810 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.406470 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.406936 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.407384 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.html5proxy_port = 6082 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.407812 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.server_listen = 127.0.0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.408229 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.408653 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] upgrade_levels.baseapi = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.409035 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] upgrade_levels.cert = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.409450 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] upgrade_levels.compute = auto {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.409846 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] upgrade_levels.conductor = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.410241 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] upgrade_levels.scheduler = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.410670 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.auth_section = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.411108 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.auth_type = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.411515 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.cafile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.411908 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.certfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.412311 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.412747 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.413141 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.keyfile = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.413544 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.413941 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vendordata_dynamic_auth.timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.414390 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.api_retry_count = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.414789 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.ca_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.415273 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.cache_prefix = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.415808 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.cluster_name = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.416319 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.connection_pool_size = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.416816 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.console_delay_seconds = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.417186 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.datastore_regex = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.417561 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.host_ip = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.417929 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.host_password = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.418299 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.host_port = 443 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.418664 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.host_username = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.419033 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.insecure = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.419421 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.integration_bridge = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.419790 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.maximum_objects = 100 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.420172 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.pbm_default_policy = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.420537 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.pbm_enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.420902 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.pbm_wsdl_location = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.421280 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.421644 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.serial_port_proxy_uri = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.422005 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.serial_port_service_uri = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.422379 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.task_poll_interval = 0.5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.422770 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.use_linked_clone = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.423172 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.vnc_keymap = en-us {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.423545 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.vnc_port = 5900 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.423914 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vmware.vnc_port_total = 10000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.424355 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.auth_schemes = ['none'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.424727 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.enabled = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.425323 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.425705 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.426090 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.novncproxy_port = 6080 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.426483 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.server_listen = 127.0.0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.427197 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.427421 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.vencrypt_ca_certs = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.427604 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.vencrypt_client_cert = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.428022 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] vnc.vencrypt_client_key = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.428379 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.428750 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.429162 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.429529 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.disable_native_luksv1 = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.429895 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.disable_rootwrap = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.430258 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.enable_numa_live_migration = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.430626 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.430993 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.431387 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.431845 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.libvirt_disable_apic = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.433263 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.433653 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.rbd_volume_local_attach = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.434041 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.434425 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.434857 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.435268 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.client_socket_timeout = 900 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.435668 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.default_pool_size = 1000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.436048 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.keep_alive = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.436430 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.max_header_line = 16384 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.436808 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.secure_proxy_ssl_header = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.437194 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.ssl_ca_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.437545 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.ssl_cert_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.437912 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.ssl_key_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.438286 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.tcp_keepidle = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.438687 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.439155 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] zvm.ca_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.439453 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] zvm.cloud_connector_url = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.439931 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.440310 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] zvm.reachable_timeout = 300 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.440742 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.enforce_new_defaults = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.441120 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.enforce_scope = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.441514 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.policy_default_rule = default {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.441940 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.442339 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.policy_file = policy.yaml {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.442771 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.444445 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.444824 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.445198 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.445593 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.446252 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.446678 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.connection_string = messaging:// {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.447055 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.enabled = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.447482 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.es_doc_type = notification {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.447874 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.es_scroll_size = 10000 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.448852 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.es_scroll_time = 2m {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.449293 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.filter_error_trace = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.449628 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.hmac_keys = SECRET_KEY {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.450014 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.sentinel_service_name = mymaster {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.450406 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.socket_timeout = 0.1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.450782 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] profiler.trace_sqlalchemy = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.451219 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.backend = sqlalchemy {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.451629 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.connection = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.452005 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.connection_debug = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.452394 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.connection_parameters = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.452783 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.connection_recycle_time = 3600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.453160 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.connection_trace = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.453531 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.db_inc_retry_interval = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.453902 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.db_max_retries = 20 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.454269 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.db_max_retry_interval = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.454637 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.db_retry_interval = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.455019 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.max_overflow = 50 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.455422 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.max_pool_size = 5 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.455800 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.max_retries = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.456175 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.mysql_enable_ndb = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.456582 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.456915 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.pool_timeout = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.457291 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.retry_interval = 10 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.457656 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.slave_connection = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.458025 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.sqlite_synchronous = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.458390 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.use_db_reconnect = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.458764 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] database.use_tpool = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.459179 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] remote_debug.host = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.459547 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] remote_debug.port = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.459957 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.460335 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.460713 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.461083 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.461463 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.461839 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.462218 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.462607 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.462986 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.463381 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.463802 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.464180 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.464570 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.464944 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.465322 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.465718 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.466088 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.466476 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.466854 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.467251 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.467689 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.468013 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.ssl = False {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.468418 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.468814 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.469247 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.469591 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.470026 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.470419 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_notifications.retry = -1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.470824 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.471257 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.471659 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_reports.file_event_handler = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.472044 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.472407 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] oslo_reports.log_dir = None {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:08:34.472710 n-d-838332-2 nova-conductor[94100]: DEBUG oslo_service.service [None req-fc735405-ad97-41cd-b174-c2d096b1c873 None None] ******************************************************************************** {{(pid=94100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:11:34.242548 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:11:34.304456 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:11:35.255471 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41364. Apr 18 20:11:35.316812 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41366. Apr 18 20:14:35.251844 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:14:35.313550 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:14:36.263455 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41430. Apr 18 20:14:36.325474 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41432. Apr 18 20:17:36.259585 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:17:36.321529 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:17:37.274082 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41510. Apr 18 20:17:37.334867 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41512. Apr 18 20:18:43.213036 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Parent process 94100 forked (94973) with an open database connection, which is being discarded and recreated. {{(pid=94973) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Apr 18 20:18:44.779276 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Took 1.56 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:18:44.814096 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_db.sqlalchemy.engines [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Parent process 94100 forked (94974) with an open database connection, which is being discarded and recreated. {{(pid=94974) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Apr 18 20:18:44.844359 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:44.850704 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:44.873612 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:18:45.300147 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.301859 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.302589 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.302994 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.329405 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94973) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:18:45.351366 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Getting quotas for project 89cd31a9914b41118419b65997ba2115. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:18:45.357391 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Getting quotas for user 6f25b879a30641d09301924191770512 and project 89cd31a9914b41118419b65997ba2115. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:18:45.373336 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] [instance: 32777e0d-6dd8-439d-8c54-d6c2ce09318d] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:18:45.374402 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.374796 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.465569 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] [instance: 32777e0d-6dd8-439d-8c54-d6c2ce09318d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:18:45.470388 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.471177 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.527283 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:18:45.579196 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.582979 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.607027 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_db.sqlalchemy.engines [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:18:45.693418 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.694030 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.694673 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1b2f4a3-377b-4066-ac45-9b38576123bc tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Acquired lock "compute-rpcapi-router" {{(pid=94973) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 18 20:18:45.696459 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-fe3aacef-fe18-4baf-aa96-a48c3ebae73c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.697320 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-fe3aacef-fe18-4baf-aa96-a48c3ebae73c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.699326 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-fe3aacef-fe18-4baf-aa96-a48c3ebae73c None None] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.699963 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-fe3aacef-fe18-4baf-aa96-a48c3ebae73c None None] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.739569 n-d-838332-2 nova-conductor[94973]: INFO nova.compute.rpcapi [None req-fe3aacef-fe18-4baf-aa96-a48c3ebae73c None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 18 20:18:45.741694 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-fe3aacef-fe18-4baf-aa96-a48c3ebae73c None None] Releasing lock "compute-rpcapi-router" {{(pid=94973) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 18 20:18:45.837320 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.838994 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.839925 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.840161 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.863412 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_db.sqlalchemy.engines [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94974) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 18 20:18:45.880732 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Getting quotas for project 1c4d302d6e8f41a9ae218a03b6ae9e8d. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:18:45.887367 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Getting quotas for user 52248bc84df745bc88bdce862f1c5ac8 and project 1c4d302d6e8f41a9ae218a03b6ae9e8d. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:18:45.899086 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] [instance: f2fd4661-6c03-4452-b648-a32148a6ba39] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:18:45.900379 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.900784 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:45.966858 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] [instance: f2fd4661-6c03-4452-b648-a32148a6ba39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:18:45.969472 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:45.969869 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:46.253504 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:46.254345 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:46.255263 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c247337f-2730-4f86-a717-a86e0a3aaa18 tempest-AggregatesAdminTestJSON-1304931368 tempest-AggregatesAdminTestJSON-1304931368-project] Acquired lock "compute-rpcapi-router" {{(pid=94974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 18 20:18:46.256543 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1133d703-158b-4e41-9458-aa25c0125750 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:46.257116 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1133d703-158b-4e41-9458-aa25c0125750 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:46.258236 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1133d703-158b-4e41-9458-aa25c0125750 None None] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:18:46.258788 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1133d703-158b-4e41-9458-aa25c0125750 None None] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:18:46.276966 n-d-838332-2 nova-conductor[94974]: INFO nova.compute.rpcapi [None req-1133d703-158b-4e41-9458-aa25c0125750 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 18 20:18:46.278519 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1133d703-158b-4e41-9458-aa25c0125750 None None] Releasing lock "compute-rpcapi-router" {{(pid=94974) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 18 20:19:08.225547 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:19:08.256972 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:08.257623 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:08.445895 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:08.446330 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:08.447354 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:08.447939 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:08.472580 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:19:08.487960 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for user e2a2b55b96e742289e8846e5f1ba6be1 and project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:19:08.500865 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 8c6711b2-223e-4a25-a3ef-8174a4bebd9d] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:19:08.502040 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:08.502657 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:08.595166 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 8c6711b2-223e-4a25-a3ef-8174a4bebd9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:19:08.596589 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:08.597175 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:08.795587 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:08.795995 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cfd3dc60-9ad1-4959-b537-7060253f5fa4 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:16.111556 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:19:16.141522 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:16.142020 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:16.303789 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:16.304803 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:16.305650 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:16.306120 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:16.325354 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Getting quotas for project 839990cf8b794e1c8ed85b6429ddae14. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:19:16.329477 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Getting quotas for user 944ee1397ee04bcc89b9a09d51054555 and project 839990cf8b794e1c8ed85b6429ddae14. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:19:16.339399 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] [instance: 0b244df5-715a-414b-97d0-db8ca4036f02] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:19:16.340329 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:16.340729 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:16.412109 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] [instance: 0b244df5-715a-414b-97d0-db8ca4036f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:19:16.413284 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:16.413686 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:16.664058 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:16.664509 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a3eb069f-519b-44a0-a8e0-088203099f18 tempest-ServerDiagnosticsNegativeTest-280199704 tempest-ServerDiagnosticsNegativeTest-280199704-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:18.229496 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:19:18.260173 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:18.260672 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:18.377359 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:18.377916 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:18.378762 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:18.379332 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:18.394742 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Getting quotas for project 89cd31a9914b41118419b65997ba2115. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:19:18.398490 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Getting quotas for user 6f25b879a30641d09301924191770512 and project 89cd31a9914b41118419b65997ba2115. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:19:18.412649 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] [instance: 94d09de3-e927-422d-a510-2388a8d4abf9] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:19:18.413538 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:18.413935 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:18.544098 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] [instance: 94d09de3-e927-422d-a510-2388a8d4abf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:19:18.545327 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:18.545719 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:18.771910 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:18.772301 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef25de6e-4b47-4aa1-89c8-0cda360b6e79 tempest-DeleteServersAdminTestJSON-298144200 tempest-DeleteServersAdminTestJSON-298144200-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:22.853900 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:19:22.877616 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:22.878281 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:23.054965 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:23.056267 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:23.057121 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:23.057822 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:23.077951 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Getting quotas for project 3c35542a5bc747c69eb67715cf97bb6c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:19:23.084834 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Getting quotas for user a72e3210630b42dfaa958332260d2524 and project 3c35542a5bc747c69eb67715cf97bb6c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:19:23.096526 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] [instance: 29c1a6c8-80ff-4486-a251-7ec8cae93002] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:19:23.104276 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:23.104276 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:23.160893 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] [instance: 29c1a6c8-80ff-4486-a251-7ec8cae93002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:19:23.162128 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:23.162516 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:23.446977 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:23.447456 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-20a11157-b44c-44cf-accf-92019e347dfc tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:34.069009 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9dd5d226-d6c0-458e-8311-a742e3652373 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:19:34.073248 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9dd5d226-d6c0-458e-8311-a742e3652373 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:34.073248 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9dd5d226-d6c0-458e-8311-a742e3652373 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:35.052876 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-9dd5d226-d6c0-458e-8311-a742e3652373 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] [instance: 8c6711b2-223e-4a25-a3ef-8174a4bebd9d] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 20:19:35.861027 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-9dd5d226-d6c0-458e-8311-a742e3652373 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Created allocations for migration c380a772-9379-4fc2-89a6-7ff35441b64e on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:19:36.467451 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-9dd5d226-d6c0-458e-8311-a742e3652373 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] [instance: 8c6711b2-223e-4a25-a3ef-8174a4bebd9d] Calling prep_resize with selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 20:19:47.094002 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:19:47.151796 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:47.152950 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:47.321162 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:47.323144 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:47.325521 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:47.328289 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:47.383373 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Getting quotas for project 3c35542a5bc747c69eb67715cf97bb6c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:19:47.394117 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Getting quotas for user a72e3210630b42dfaa958332260d2524 and project 3c35542a5bc747c69eb67715cf97bb6c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:19:47.433561 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] [instance: f1154af1-25dd-43bc-8120-30d62594554e] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:19:47.444305 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:47.444305 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:47.544402 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] [instance: f1154af1-25dd-43bc-8120-30d62594554e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:19:47.545847 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:47.546401 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:47.808283 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:47.809085 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e226ed43-7b06-4470-bbd8-e1308eb7ac43 tempest-LiveMigrationNegativeTest-598288438 tempest-LiveMigrationNegativeTest-598288438-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:58.714365 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:19:58.737672 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:58.738306 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:59.008225 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:59.009116 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:59.010364 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:59.011540 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:59.040616 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:19:59.047969 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for user 21ae6497b6d8453ca05c839812d9ce55 and project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:19:59.102968 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 71a56981-ebfe-4dff-8cff-bfe02b3795d3] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:19:59.109904 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:59.110461 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:59.189009 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 71a56981-ebfe-4dff-8cff-bfe02b3795d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:19:59.190506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:59.190905 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:19:59.435286 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:19:59.436147 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3f4d759e-b730-484c-9b0a-b0c6660ec940 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:18.191866 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:20:18.242966 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:18.243392 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:18.402682 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:18.403099 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:18.404781 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:18.405542 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:18.435442 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:20:18.442441 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for user e2a2b55b96e742289e8846e5f1ba6be1 and project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:20:18.458242 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 437ba7d7-1667-43f6-9084-704447b11bb8] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:20:18.459663 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:18.460254 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:18.522155 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 437ba7d7-1667-43f6-9084-704447b11bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:20:18.523446 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:18.524014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:18.811131 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:18.811721 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f67cab35-a0f1-46e6-911f-234360fa66d5 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:21.978746 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:20:22.005062 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:22.013753 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:22.226219 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:22.226877 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:22.228129 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:22.233106 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:22.277509 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Getting quotas for project b85d70067c9847b098e254da19d55590. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:20:22.284237 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Getting quotas for user 852b3e9d99ab44958bdc65bae5caae26 and project b85d70067c9847b098e254da19d55590. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:20:22.320771 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] [instance: fc3b638a-8772-4044-83f9-2a3f5686d5aa] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:20:22.324309 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:22.325102 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:22.428697 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] [instance: fc3b638a-8772-4044-83f9-2a3f5686d5aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:20:22.430141 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:22.430543 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:22.692369 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:22.693115 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7bd7ad62-dd54-45f7-8948-00cab712ec64 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:25.001126 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:20:25.002252 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:25.004342 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:25.986948 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Created allocations for migration 72fafc86-0f42-485c-ae35-7369561a978a on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94974) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:20:26.315437 n-d-838332-2 nova-conductor[94974]: DEBUG nova.scheduler.utils [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 71a56981-ebfe-4dff-8cff-bfe02b3795d3] Instance allocations successfully created on destination node 65455175-3040-428f-952a-6449c7e9beb4: {'allocations': {'65455175-3040-428f-952a-6449c7e9beb4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94974) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:20:26.315437 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'resources' on Instance uuid 71a56981-ebfe-4dff-8cff-bfe02b3795d3 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:20:26.321490 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'pci_requests' on Instance uuid 71a56981-ebfe-4dff-8cff-bfe02b3795d3 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:20:27.220088 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.live_migrate [None req-6e70b5bf-9b65-4fac-9f8c-89ade98d4a2e tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 71a56981-ebfe-4dff-8cff-bfe02b3795d3] Start binding ports on destination host: n-h2-838332-2 {{(pid=94974) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:20:32.670916 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:20:32.751452 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:32.754901 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:33.000153 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:33.000741 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:33.001809 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:33.003093 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:33.053483 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Getting quotas for project 6970323460d84e1b81af213168bbc544. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:20:33.065663 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Getting quotas for user 55aeb7dd1b8b46c6a8c1e4d884f20064 and project 6970323460d84e1b81af213168bbc544. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:20:33.091941 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] [instance: c05beff2-d276-41ee-9a03-d9e6b74b67f0] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:20:33.096777 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:33.097440 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:33.166924 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] [instance: c05beff2-d276-41ee-9a03-d9e6b74b67f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:20:33.171519 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:33.172325 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:33.435818 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:33.436662 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d03a35bd-9aba-4358-ae9d-c64bea4cf5a0 tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:39.297592 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-37c38c5d-dfaf-45ea-9d62-a9fa9b55a49a tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:20:39.298086 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-37c38c5d-dfaf-45ea-9d62-a9fa9b55a49a tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:39.298472 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-37c38c5d-dfaf-45ea-9d62-a9fa9b55a49a tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:40.159476 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-37c38c5d-dfaf-45ea-9d62-a9fa9b55a49a tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 437ba7d7-1667-43f6-9084-704447b11bb8] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94974) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 20:20:41.021102 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-37c38c5d-dfaf-45ea-9d62-a9fa9b55a49a tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Created allocations for migration 793cfa74-b4a8-4b9f-bba4-1eb671301df0 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94974) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:20:41.580534 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-37c38c5d-dfaf-45ea-9d62-a9fa9b55a49a tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 437ba7d7-1667-43f6-9084-704447b11bb8] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94974) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 20:20:45.790680 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:20:45.816445 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:45.816963 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:46.144125 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:46.144538 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:46.145250 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:46.145633 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:46.169777 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Getting quotas for project 3a64e865ff804b5197e03c4e5ff9a773. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:20:46.174664 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Getting quotas for user 7728c6f4b3a64f028189437c7ae47185 and project 3a64e865ff804b5197e03c4e5ff9a773. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:20:46.185710 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] [instance: 92f4164f-5e13-4884-9753-1a36d97b77c1] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:20:46.186871 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:46.187466 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:46.257506 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] [instance: 92f4164f-5e13-4884-9753-1a36d97b77c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:20:46.259394 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:46.260261 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:46.474504 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:46.474901 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-618a62b2-767a-4222-a9fd-c873d7ca4b74 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:52.477760 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:20:52.506018 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:52.506411 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:52.666562 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:52.667291 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:52.669153 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:52.672302 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:52.713916 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:20:52.726573 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for user 21ae6497b6d8453ca05c839812d9ce55 and project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:20:52.738256 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 89c5b3a2-f6f8-4cf3-bc61-1bec14b4b26c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:20:52.739960 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:52.740538 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:52.818401 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 89c5b3a2-f6f8-4cf3-bc61-1bec14b4b26c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:20:52.819736 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:52.820128 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:53.045897 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:53.048239 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9fe92b3-f486-4e5e-9c9f-5045af212f16 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:55.849865 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:20:55.920507 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:55.921840 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:56.076717 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:56.077489 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:56.078620 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:56.079324 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:56.119157 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Getting quotas for project 6970323460d84e1b81af213168bbc544. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:20:56.124021 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Getting quotas for user 55aeb7dd1b8b46c6a8c1e4d884f20064 and project 6970323460d84e1b81af213168bbc544. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:20:56.136915 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] [instance: d77232a6-0c72-4b06-927f-8a0f585c34ab] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:20:56.139594 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:56.139594 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:56.240889 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] [instance: d77232a6-0c72-4b06-927f-8a0f585c34ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:20:56.242453 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:56.242950 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:20:56.548271 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:20:56.548844 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9c5f12f1-b25a-48c5-bada-1a4d6215f63b tempest-ServersAdminNegativeTestJSON-601650035 tempest-ServersAdminNegativeTestJSON-601650035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:01.183877 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:21:01.227752 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:01.228132 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:01.412022 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:01.412759 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:01.413498 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:01.414066 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:01.463777 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:21:01.476266 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for user 251ace53a8a945ce83c19515dc2175a8 and project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:21:01.497217 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: c1e2fbac-cedd-40b5-b7c6-aaf1eb8c8e9e] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:21:01.498371 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:01.498930 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:01.565264 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: c1e2fbac-cedd-40b5-b7c6-aaf1eb8c8e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:21:01.567668 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:01.568232 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:01.793579 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:01.793993 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-92eb21a4-39d2-4fe1-bca9-d7dc596ae902 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:16.078738 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:21:16.101240 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:16.101792 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:16.252064 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:16.252497 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:16.255577 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:16.258876 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:16.294518 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Getting quotas for project 3a64e865ff804b5197e03c4e5ff9a773. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:21:16.305126 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Getting quotas for user 7728c6f4b3a64f028189437c7ae47185 and project 3a64e865ff804b5197e03c4e5ff9a773. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:21:16.325582 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] [instance: 66b6b4d9-66a1-4576-bd5f-63b2216b8071] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:21:16.328014 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:16.331845 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:16.411345 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] [instance: 66b6b4d9-66a1-4576-bd5f-63b2216b8071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:21:16.413655 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:16.414200 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:16.702093 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:16.702503 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3cced497-a188-4f6b-9afd-17beea2d5514 tempest-FloatingIPsAssociationTestJSON-1891545452 tempest-FloatingIPsAssociationTestJSON-1891545452-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:19.121834 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:21:19.123619 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:19.124223 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:20.012854 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Created allocations for migration 19511b76-a39d-4c33-aa8c-4fcf23dbad56 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94974) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:21:20.402979 n-d-838332-2 nova-conductor[94974]: DEBUG nova.scheduler.utils [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 89c5b3a2-f6f8-4cf3-bc61-1bec14b4b26c] Instance allocations successfully created on destination node 65455175-3040-428f-952a-6449c7e9beb4: {'allocations': {'65455175-3040-428f-952a-6449c7e9beb4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94974) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:21:20.404426 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'resources' on Instance uuid 89c5b3a2-f6f8-4cf3-bc61-1bec14b4b26c {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:21:20.412010 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'pci_requests' on Instance uuid 89c5b3a2-f6f8-4cf3-bc61-1bec14b4b26c {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:21:21.048642 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.live_migrate [None req-e6c8cfcb-7e06-4407-a862-2c57a35b1daa tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 89c5b3a2-f6f8-4cf3-bc61-1bec14b4b26c] Start binding ports on destination host: n-h2-838332-2 {{(pid=94974) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:21:33.108881 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:21:33.110328 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:33.111223 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:33.819870 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Created allocations for migration ccdcd058-143c-4ddc-b4f0-c88426d85607 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:21:34.122669 n-d-838332-2 nova-conductor[94973]: DEBUG nova.scheduler.utils [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: c1e2fbac-cedd-40b5-b7c6-aaf1eb8c8e9e] Instance allocations successfully created on destination node b023a38b-7560-4ce7-aafe-990353c156b6: {'allocations': {'b023a38b-7560-4ce7-aafe-990353c156b6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94973) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:21:34.124041 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'resources' on Instance uuid c1e2fbac-cedd-40b5-b7c6-aaf1eb8c8e9e {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:21:34.131024 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'pci_requests' on Instance uuid c1e2fbac-cedd-40b5-b7c6-aaf1eb8c8e9e {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:21:35.078110 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.live_migrate [None req-aa1d5994-11be-433b-9968-7289347b99de tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: c1e2fbac-cedd-40b5-b7c6-aaf1eb8c8e9e] Start binding ports on destination host: n-h1-838332-2 {{(pid=94973) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:21:35.233577 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:21:35.257585 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:35.257985 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:35.429863 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:35.431188 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:35.433397 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:35.435242 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:35.469642 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:21:35.476695 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for user e2a2b55b96e742289e8846e5f1ba6be1 and project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:21:35.496722 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: e234e5a7-83f1-4c75-9eba-924593535fb7] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:21:35.497909 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:35.498479 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:35.592586 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: e234e5a7-83f1-4c75-9eba-924593535fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:21:35.593833 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:35.594229 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:35.781044 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:35.781438 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b7e6617f-bf6b-4c4e-bf1c-afddfdeb3af0 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:43.500857 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:21:43.524022 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:43.524427 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:43.718749 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:43.719183 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:43.720078 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:43.720458 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:43.738811 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Getting quotas for project da038c808a2a455ab78e9241ff5dbcee. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:21:43.743765 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Getting quotas for user 68a3c8aefe0a42a1a83574bc4cc59252 and project da038c808a2a455ab78e9241ff5dbcee. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:21:43.755600 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] [instance: c03349a7-4e25-424e-8411-15e0b57d21d3] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:21:43.756767 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:43.757154 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:43.828861 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] [instance: c03349a7-4e25-424e-8411-15e0b57d21d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:21:43.833113 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:43.833669 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:44.108361 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:44.108915 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-754dd6cc-9338-4afc-a659-e649c6960c69 tempest-ImagesNegativeTestJSON-2087088133 tempest-ImagesNegativeTestJSON-2087088133-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:58.114044 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:21:58.142147 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:58.143427 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:58.270589 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:58.271047 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:58.274175 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:58.274789 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:58.328238 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:21:58.336763 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for user 21ae6497b6d8453ca05c839812d9ce55 and project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:21:58.356709 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 2fb1b665-767f-4806-8a7c-983afb7f304f] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:21:58.359368 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:58.359903 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:58.456418 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 2fb1b665-767f-4806-8a7c-983afb7f304f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:21:58.457783 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:58.458116 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:21:58.766492 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:21:58.766492 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-27437fd1-64bf-4700-9ef3-58ab5e290ce8 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:01.957808 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-729f5380-16dc-447a-998d-7343d963c6f3 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:22:01.958336 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-729f5380-16dc-447a-998d-7343d963c6f3 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:01.958787 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-729f5380-16dc-447a-998d-7343d963c6f3 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:02.297720 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-729f5380-16dc-447a-998d-7343d963c6f3 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: e234e5a7-83f1-4c75-9eba-924593535fb7] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 20:22:03.030074 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-729f5380-16dc-447a-998d-7343d963c6f3 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Created allocations for migration 2a07511e-9f83-440a-ad73-576fd193330b on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:22:03.456439 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-729f5380-16dc-447a-998d-7343d963c6f3 tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: e234e5a7-83f1-4c75-9eba-924593535fb7] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 20:22:03.746701 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:22:03.776047 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:03.777374 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:03.900950 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:03.901547 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:03.902453 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:03.903044 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:03.920266 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:22:03.926446 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for user 251ace53a8a945ce83c19515dc2175a8 and project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:22:03.936606 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: fa0ed641-7733-4dc6-a62e-88175c168f1d] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:22:03.937553 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:03.937966 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:04.038264 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: fa0ed641-7733-4dc6-a62e-88175c168f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:22:04.039700 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:04.040124 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:04.226617 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:04.227105 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-69334a1c-f793-42b0-93d7-99363fd733a1 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.191535 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:22:16.218713 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.219443 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.362182 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.362957 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.363960 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.364755 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.383992 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Getting quotas for project b85d70067c9847b098e254da19d55590. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:22:16.390785 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Getting quotas for user 852b3e9d99ab44958bdc65bae5caae26 and project b85d70067c9847b098e254da19d55590. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:22:16.404906 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] [instance: ecf4947e-f8f6-44c5-bafd-4a75d6854125] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:22:16.406824 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.408180 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.490140 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] [instance: ecf4947e-f8f6-44c5-bafd-4a75d6854125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:22:16.492013 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.492217 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.587136 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.587589 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:16.850793 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:16.851256 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-dc965bc8-49fa-4cf2-9970-bbae7d854e31 tempest-ServersWithSpecificFlavorTestJSON-369329337 tempest-ServersWithSpecificFlavorTestJSON-369329337-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:34.431407 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:22:34.484042 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:34.484503 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:34.726744 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:34.727145 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:34.727860 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:34.728620 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:34.747533 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Getting quotas for project 9026300f17074d36b6466f1057d31930. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:22:34.753358 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Getting quotas for user 5bc6b570d0d04cbf97cb506d4ac317f9 and project 9026300f17074d36b6466f1057d31930. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:22:34.765656 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] [instance: aa8f2b97-eeee-48c8-bc88-9bd35fc75c54] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:22:34.767194 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:34.767748 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:34.837248 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] [instance: aa8f2b97-eeee-48c8-bc88-9bd35fc75c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:22:34.839085 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:34.839488 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:35.145914 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:35.146610 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8f192108-bb2a-4071-b2d4-bca44c979d51 tempest-ServersTestJSON-1484692413 tempest-ServersTestJSON-1484692413-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:39.164808 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:22:39.168012 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:39.168012 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:40.316101 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Created allocations for migration 831e0875-62e8-4a8a-b47b-258511884fe1 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:22:40.636591 n-d-838332-2 nova-conductor[94973]: DEBUG nova.scheduler.utils [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: fa0ed641-7733-4dc6-a62e-88175c168f1d] Instance allocations successfully created on destination node b023a38b-7560-4ce7-aafe-990353c156b6: {'allocations': {'b023a38b-7560-4ce7-aafe-990353c156b6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94973) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:22:40.637756 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'resources' on Instance uuid fa0ed641-7733-4dc6-a62e-88175c168f1d {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:22:40.645391 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'pci_requests' on Instance uuid fa0ed641-7733-4dc6-a62e-88175c168f1d {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:22:41.337848 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.live_migrate [None req-a05f8494-3509-4690-8c67-102d6e64a800 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: fa0ed641-7733-4dc6-a62e-88175c168f1d] Start binding ports on destination host: n-h1-838332-2 {{(pid=94973) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:22:44.460251 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:22:44.484667 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:44.485444 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:44.657530 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:44.658030 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:44.659479 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:44.659908 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:44.695676 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Getting quotas for project c68354a81ace4a18867f871bf8cf2455. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:22:44.706050 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Getting quotas for user 0d04a79735d94f5eabf00975791f2e6c and project c68354a81ace4a18867f871bf8cf2455. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:22:44.727783 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] [instance: 82c87e41-2257-482b-8ec7-86c50d2eb3c8] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:22:44.729732 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:44.730331 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:44.826438 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] [instance: 82c87e41-2257-482b-8ec7-86c50d2eb3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:22:44.828868 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:44.829571 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:45.146828 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:45.147348 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a824f3-909d-4725-bed9-26bb3ebc036b tempest-ImagesOneServerTestJSON-1426427930 tempest-ImagesOneServerTestJSON-1426427930-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:46.164954 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:22:46.166007 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:46.166571 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:47.087080 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Created allocations for migration 5a991210-6227-4738-8028-b69ced98827e on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:22:47.370128 n-d-838332-2 nova-conductor[94973]: DEBUG nova.scheduler.utils [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 2fb1b665-767f-4806-8a7c-983afb7f304f] Instance allocations successfully created on destination node 65455175-3040-428f-952a-6449c7e9beb4: {'allocations': {'65455175-3040-428f-952a-6449c7e9beb4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94973) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:22:47.370976 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'resources' on Instance uuid 2fb1b665-767f-4806-8a7c-983afb7f304f {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:22:47.375964 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'pci_requests' on Instance uuid 2fb1b665-767f-4806-8a7c-983afb7f304f {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:22:48.082207 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.live_migrate [None req-7660cc14-7d2b-446b-be99-83971722ebdb tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 2fb1b665-767f-4806-8a7c-983afb7f304f] Start binding ports on destination host: n-h2-838332-2 {{(pid=94973) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:22:59.176449 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:22:59.215798 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:59.216514 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:59.458296 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:59.458984 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:59.459754 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:59.460141 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:59.481634 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Getting quotas for project b99b9f65c002436a983b14c588973135. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:22:59.487290 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Getting quotas for user df07620be0dc4d5989a571b63d3ef8b3 and project b99b9f65c002436a983b14c588973135. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:22:59.501964 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] [instance: 8f3e5029-d09b-4a51-9438-1cfe751b09a4] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:22:59.503245 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:59.503882 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:59.575761 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] [instance: 8f3e5029-d09b-4a51-9438-1cfe751b09a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:22:59.577469 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:59.578224 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:22:59.847995 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:22:59.848359 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5a30e9ba-8358-4701-99f9-a3eca1b95b30 tempest-FloatingIPsAssociationNegativeTestJSON-177190043 tempest-FloatingIPsAssociationNegativeTestJSON-177190043-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:06.544147 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:23:06.601285 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:06.601698 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:06.766684 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:06.767111 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:06.767838 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:06.768231 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:06.808598 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:23:06.820643 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for user 251ace53a8a945ce83c19515dc2175a8 and project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:23:06.843711 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: 8b7dc131-992c-428a-8abb-76f7f8710af6] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:23:06.851138 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:06.851472 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:06.957251 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: 8b7dc131-992c-428a-8abb-76f7f8710af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:23:06.961453 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:06.961453 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:07.266815 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:07.267322 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f39082f1-d374-4ae7-abab-e88ddc48d6e2 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:07.953958 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:23:08.011941 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:08.012596 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:08.203056 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:08.203056 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:08.203056 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:08.203056 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:08.250962 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:23:08.261758 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Getting quotas for user e2a2b55b96e742289e8846e5f1ba6be1 and project 8182c1cafd1f4c81bb2fb8ce51818259. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:23:08.290824 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 2e1ab07e-6f6e-4ea1-ad90-6fbd36c63295] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:23:08.297982 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:08.298888 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:08.393330 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] [instance: 2e1ab07e-6f6e-4ea1-ad90-6fbd36c63295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:23:08.394607 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:08.395016 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:08.699825 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:08.700240 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6a8f1c4d-62bd-40d7-b320-1524409af58d tempest-MigrationsAdminTest-2137209444 tempest-MigrationsAdminTest-2137209444-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:26.349390 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:23:27.362975 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48830. Apr 18 20:23:38.894279 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f5a6ef82-3139-4b04-8e80-f057e74031f8 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:23:38.896224 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f5a6ef82-3139-4b04-8e80-f057e74031f8 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:38.897668 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f5a6ef82-3139-4b04-8e80-f057e74031f8 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:39.515588 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-f5a6ef82-3139-4b04-8e80-f057e74031f8 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] [instance: 2e1ab07e-6f6e-4ea1-ad90-6fbd36c63295] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 20:23:40.265951 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-f5a6ef82-3139-4b04-8e80-f057e74031f8 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] Created allocations for migration dc8ee0fd-b2c4-4314-962f-c74e17b0fd03 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:23:40.884455 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-f5a6ef82-3139-4b04-8e80-f057e74031f8 tempest-MigrationsAdminTest-1747461385 tempest-MigrationsAdminTest-1747461385-project-admin] [instance: 2e1ab07e-6f6e-4ea1-ad90-6fbd36c63295] Calling prep_resize with selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 20:23:56.334772 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:23:56.359609 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:56.360010 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:56.637244 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:56.638255 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:56.638979 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:56.639576 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:56.656794 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Getting quotas for project 358fce809d4a41869548548671728381. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:23:56.661624 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Getting quotas for user 339150bebab745b7ab58ebf34087df00 and project 358fce809d4a41869548548671728381. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:23:56.672511 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] [instance: 9f0d6dee-4432-46a8-98e3-77b78e4928e1] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:23:56.673832 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:56.673832 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:56.789951 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] [instance: 9f0d6dee-4432-46a8-98e3-77b78e4928e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:23:56.791282 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:56.791717 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:23:57.104717 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:23:57.105132 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dc8c7077-a8fe-4ff1-bb09-a4c2abc6564e tempest-ServersTestManualDisk-892223035 tempest-ServersTestManualDisk-892223035-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:05.744271 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:24:05.745525 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:05.746092 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:06.810528 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Created allocations for migration a05f10c4-36b7-4ad3-941d-6a68dd57dba0 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:24:07.171849 n-d-838332-2 nova-conductor[94973]: DEBUG nova.scheduler.utils [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: 8b7dc131-992c-428a-8abb-76f7f8710af6] Instance allocations successfully created on destination node b023a38b-7560-4ce7-aafe-990353c156b6: {'allocations': {'b023a38b-7560-4ce7-aafe-990353c156b6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=94973) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:24:07.172273 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'resources' on Instance uuid 8b7dc131-992c-428a-8abb-76f7f8710af6 {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:24:07.182354 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'pci_requests' on Instance uuid 8b7dc131-992c-428a-8abb-76f7f8710af6 {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:24:08.104572 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.live_migrate [None req-be832206-f083-433c-9b93-b429fcfe9757 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: 8b7dc131-992c-428a-8abb-76f7f8710af6] Start binding ports on destination host: n-h1-838332-2 {{(pid=94973) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:24:14.351301 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:24:14.402582 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:14.403259 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:14.607624 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:14.607915 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:14.608657 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:14.609050 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:14.695865 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:24:14.718075 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Getting quotas for user 21ae6497b6d8453ca05c839812d9ce55 and project eb952f6a8e1b4e2fb5543c91f26e6115. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:24:14.762271 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 433c3d40-ca76-4759-882a-24377af07643] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:24:14.768224 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:14.771372 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:14.894127 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] [instance: 433c3d40-ca76-4759-882a-24377af07643] block_device_mapping [BlockDeviceMapping(attachment_id=bb54db6b-cdd3-4fbe-9099-95ed89919e42,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f737c26-0729-4137-b6e6-d3079eeba0a6',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:24:14.895343 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:14.895747 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:15.208307 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:15.208717 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c2cd88b9-c8ca-4081-8b82-8a2f760e5945 tempest-LiveAutoBlockMigrationV225Test-1736255892 tempest-LiveAutoBlockMigrationV225Test-1736255892-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:45.915391 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:24:45.917810 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:24:45.918450 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:24:46.838079 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Created allocations for migration 5f3b1d82-776e-424e-9b44-e000cbc0df08 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:24:47.237496 n-d-838332-2 nova-conductor[94973]: DEBUG nova.scheduler.utils [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 433c3d40-ca76-4759-882a-24377af07643] Instance allocations successfully created on destination node 65455175-3040-428f-952a-6449c7e9beb4: {'allocations': {'65455175-3040-428f-952a-6449c7e9beb4': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=94973) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:24:47.239347 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'resources' on Instance uuid 433c3d40-ca76-4759-882a-24377af07643 {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:24:47.246023 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] Lazy-loading 'pci_requests' on Instance uuid 433c3d40-ca76-4759-882a-24377af07643 {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:24:47.772052 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.live_migrate [None req-8483609b-f118-4105-99e4-2fffffb07b01 tempest-LiveAutoBlockMigrationV225Test-458094176 tempest-LiveAutoBlockMigrationV225Test-458094176-project-admin] [instance: 433c3d40-ca76-4759-882a-24377af07643] Start binding ports on destination host: n-h2-838332-2 {{(pid=94973) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:25:17.791467 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Took 0.95 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:25:17.853270 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:17.858357 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:18.271567 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:18.272229 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:18.280585 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:18.282328 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:18.301059 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Getting quotas for project 07a54a6c1ff04facbf6eb2a223175e57. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:25:18.307668 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Getting quotas for user 63c167fbed8847c69ad1d052d2a9e298 and project 07a54a6c1ff04facbf6eb2a223175e57. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:25:18.321971 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] [instance: 21e44ff9-f19a-4cb4-a6d7-a7d6a4680fca] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:25:18.323175 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:18.323733 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:18.446120 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] [instance: 21e44ff9-f19a-4cb4-a6d7-a7d6a4680fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:25:18.448150 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:18.449254 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:18.989615 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:18.990958 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b479b218-2c37-4931-8e81-b57c2d3c4d10 tempest-InstanceActionsTestJSON-2113127009 tempest-InstanceActionsTestJSON-2113127009-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:20.307996 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Took 1.17 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:25:20.384911 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:20.385842 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:20.803491 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:20.804455 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:20.805975 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:20.808001 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:20.846728 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Getting quotas for project 422ad8fc8f334c069b89ae41a6d0c842. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:25:20.859360 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Getting quotas for user 64ed9750a1b44146826713ff5ba6cbe3 and project 422ad8fc8f334c069b89ae41a6d0c842. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:25:20.883006 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] [instance: e95a7341-ed08-42ce-98cf-c5e08a2dc28a] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:25:20.885303 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:20.886042 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:21.052515 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] [instance: e95a7341-ed08-42ce-98cf-c5e08a2dc28a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:25:21.053903 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:21.053903 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:21.463717 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:21.464393 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-4685c6c8-977f-4d48-ac22-9ac7fb6f8dc8 tempest-ServerRescueTestJSONUnderV235-828996690 tempest-ServerRescueTestJSONUnderV235-828996690-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:37.106255 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:25:37.170768 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:37.171201 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:37.377629 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:37.378560 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:37.379518 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:37.380578 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:37.402218 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:25:37.408065 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Getting quotas for user 251ace53a8a945ce83c19515dc2175a8 and project 45dac3d78f6d493da6c94316a16af049. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:25:37.422047 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: ba26908b-9279-4294-909d-af4e243f7ed7] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:25:37.423305 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:37.425440 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:37.541338 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] [instance: ba26908b-9279-4294-909d-af4e243f7ed7] block_device_mapping [BlockDeviceMapping(attachment_id=b4c677ac-743c-4efd-86a3-bcad9e7603fd,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='935c7b7d-6e50-42ac-816a-5fae6e7210af',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:25:37.543250 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:37.543954 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:37.816377 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:37.823274 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-028fbc31-7722-4d7a-a8c8-b148f6d1aa21 tempest-LiveMigrationTest-1961602417 tempest-LiveMigrationTest-1961602417-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:43.626965 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:25:43.662020 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:43.662780 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:43.893710 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:43.894269 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:43.896908 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:43.897545 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:43.930751 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Getting quotas for project 28ed74ee7a9441aea7580e3b9802dd04. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:25:43.937757 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Getting quotas for user adf3450fbf6f4735a4559e0857b4ffff and project 28ed74ee7a9441aea7580e3b9802dd04. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:25:43.966812 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: 90998f27-5679-4bd4-9ca2-befbd4d6667b] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:25:43.968825 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:43.969391 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:44.039437 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: 90998f27-5679-4bd4-9ca2-befbd4d6667b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:25:44.041312 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:44.042089 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:44.406219 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:44.406649 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-667565a3-db5c-4603-817d-0163b16fb5bc tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:53.287870 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:25:53.318451 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:53.323570 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:53.543264 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:53.544097 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:53.545422 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:53.546041 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:53.572803 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Getting quotas for project 3fe6ed159b2e4e26a316125084e19e3c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:25:53.582210 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Getting quotas for user 697adf50939a4a819d7c55d91a954f9d and project 3fe6ed159b2e4e26a316125084e19e3c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:25:53.600891 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] [instance: 0974766b-309e-42c1-ac1b-7ddf9f0af340] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:25:53.602751 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:53.603539 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:53.680557 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] [instance: 0974766b-309e-42c1-ac1b-7ddf9f0af340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:25:53.681873 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:53.682318 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:25:54.005100 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:25:54.005499 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a712c95-9352-47db-ac4d-e71ca37b45d6 tempest-TenantUsagesTestJSON-934125397 tempest-TenantUsagesTestJSON-934125397-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:06.839269 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-27559329-6b53-4818-b251-3758ece8162c tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:26:06.842833 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-27559329-6b53-4818-b251-3758ece8162c tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:06.842833 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-27559329-6b53-4818-b251-3758ece8162c tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:07.077459 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-27559329-6b53-4818-b251-3758ece8162c tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: 90998f27-5679-4bd4-9ca2-befbd4d6667b] No migration record for the rebuild/evacuate request. {{(pid=94973) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:26:10.199790 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:26:10.223322 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:10.223727 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:10.566220 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:10.568786 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:10.576956 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:10.576956 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:10.611384 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Getting quotas for project 6518332cd4524cf5a2b436065cf15ade. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:26:10.625593 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Getting quotas for user 1d5e9d9bdbbb4264a36c1533edb28721 and project 6518332cd4524cf5a2b436065cf15ade. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:26:10.670839 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] [instance: 2d0f560e-f508-4649-b708-a1e5c2de3fa5] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:26:10.673240 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:10.678723 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:10.831501 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] [instance: 2d0f560e-f508-4649-b708-a1e5c2de3fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:26:10.832999 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:10.833561 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.109919 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:26:11.148528 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.148995 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.197420 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.197829 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-3a554cf2-5f1b-4028-abe0-ec12bcc94ab8 tempest-InstanceActionsNegativeTestJSON-815762953 tempest-InstanceActionsNegativeTestJSON-815762953-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.437992 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:26:11.439199 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.439896 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.536739 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.537404 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.538292 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.538866 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.629864 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Getting quotas for project 4c75416d7a164501826cb268d7e0d65c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:26:11.636731 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Getting quotas for user 16701553761346458ffb8f4165ecea46 and project 4c75416d7a164501826cb268d7e0d65c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:26:11.651451 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] [instance: 630d548f-1f2b-4598-930a-826b6c5d0bba] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:26:11.653533 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.654176 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.782053 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] [instance: 630d548f-1f2b-4598-930a-826b6c5d0bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:26:11.783506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.783973 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:11.839752 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:26:11.870267 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:11.870997 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:12.112421 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:12.113484 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:12.114371 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:12.114949 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:12.134332 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Getting quotas for project 4c75416d7a164501826cb268d7e0d65c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:26:12.140381 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Getting quotas for user 16701553761346458ffb8f4165ecea46 and project 4c75416d7a164501826cb268d7e0d65c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:26:12.152940 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] [instance: 12320b26-ce8e-4d0f-9fdc-9a1c2e26cad4] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:26:12.154246 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:12.160429 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:12.193659 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:12.194916 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-80160be6-2e9a-467c-bb52-6f93377eeb1e tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:12.262096 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] [instance: 12320b26-ce8e-4d0f-9fdc-9a1c2e26cad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:26:12.263520 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:12.263914 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:12.456636 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Created allocations for migration 471b1125-9a00-407f-8f8a-436466de5303 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94974) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 20:26:12.839163 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:26:12.841161 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ef8d98e5-9fc8-4f90-8ef7-67e16ae0e081 tempest-ListImageFiltersTestJSON-907436065 tempest-ListImageFiltersTestJSON-907436065-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:26:13.026423 n-d-838332-2 nova-conductor[94974]: DEBUG nova.scheduler.utils [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: ba26908b-9279-4294-909d-af4e243f7ed7] Instance allocations successfully created on destination node b023a38b-7560-4ce7-aafe-990353c156b6: {'allocations': {'b023a38b-7560-4ce7-aafe-990353c156b6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=94974) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:827}} Apr 18 20:26:13.026850 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'resources' on Instance uuid ba26908b-9279-4294-909d-af4e243f7ed7 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:26:13.033739 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] Lazy-loading 'pci_requests' on Instance uuid ba26908b-9279-4294-909d-af4e243f7ed7 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:26:14.104526 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.live_migrate [None req-52160ee2-bbba-4acb-bb6c-de70e59fe5f0 tempest-LiveMigrationTest-71796230 tempest-LiveMigrationTest-71796230-project-admin] [instance: ba26908b-9279-4294-909d-af4e243f7ed7] Start binding ports on destination host: n-h1-838332-2 {{(pid=94974) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 20:27:05.232659 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Took 0.99 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:27:05.287047 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.291658 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:05.505656 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.506457 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:05.507518 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.508221 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:05.548966 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Getting quotas for project e53b2305d90449a192f6e400b6f6d398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:27:05.565579 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Getting quotas for user 57463825fdc64b35ba18105d682917e9 and project e53b2305d90449a192f6e400b6f6d398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:27:05.588768 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] [instance: 3d2f966a-415f-45eb-b0f8-1d03733b24fc] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:27:05.592817 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.600757 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:05.710810 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] [instance: 3d2f966a-415f-45eb-b0f8-1d03733b24fc] block_device_mapping [BlockDeviceMapping(attachment_id=9c933547-a755-4087-aaf5-092434530660,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5fbf1583-41bf-4ef7-bc77-9efc55b3f46c',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=8784e487-82d1-43c4-9893-7789455b873b,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='806055eb-f761-4d26-8ab9-850bf7afafd6',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=dfa4e1fb-17ae-47fa-a24d-7f126999bea9,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='825477e2-05f9-431e-9c1c-004917535ddb',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:27:05.713562 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.728396 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:05.831686 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.832293 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:05.942027 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:05.945575 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:06.258552 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:06.259791 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1476eeef-21cc-46da-b195-3d02b258b84a tempest-TaggedBootDevicesTest-1748886308 tempest-TaggedBootDevicesTest-1748886308-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:08.384442 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Took 0.94 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:27:08.465965 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:08.467700 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:08.790555 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:08.792872 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:08.793674 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:08.801241 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:08.827804 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Getting quotas for project b36a6aa23cc54651b6801b9efb0e050d. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:27:08.838788 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Getting quotas for user 739993ff2c994775805f287890b23a08 and project b36a6aa23cc54651b6801b9efb0e050d. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:27:08.857504 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] [instance: ab2542c7-48fe-46d0-83fb-ab9080a93d0e] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:27:08.858934 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:08.859736 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:08.986805 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] [instance: ab2542c7-48fe-46d0-83fb-ab9080a93d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:27:08.988438 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:08.989564 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:09.320551 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:09.320551 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e017db7d-82fc-4bed-bd0a-429cd10216a3 tempest-ServerTagsTestJSON-971350407 tempest-ServerTagsTestJSON-971350407-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:23.184685 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:27:23.312835 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:23.319798 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:23.661133 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:23.664205 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:23.665129 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:23.668641 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:23.711160 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Getting quotas for project 28ed74ee7a9441aea7580e3b9802dd04. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:27:23.718422 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Getting quotas for user adf3450fbf6f4735a4559e0857b4ffff and project 28ed74ee7a9441aea7580e3b9802dd04. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:27:23.752119 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: 16bc83f4-0165-4b0f-ae0f-4b93f6744469] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:27:23.756408 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:23.758362 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:23.883293 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: 16bc83f4-0165-4b0f-ae0f-4b93f6744469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:27:23.884896 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:23.886001 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:24.255473 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:24.256187 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-01063a83-7342-4fbd-84a7-430970c01197 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:34.169832 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:27:35.180700 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53604. Apr 18 20:27:50.891796 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Took 1.16 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:27:50.961264 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:50.966426 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:51.244668 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:51.245244 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:51.248152 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:51.248550 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:51.292406 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Getting quotas for project c0867c0604b74c5ba96c42da5fc6f158. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:27:51.304781 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Getting quotas for user fea0e4c177f945b7a169ede091719162 and project c0867c0604b74c5ba96c42da5fc6f158. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:27:51.352751 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] [instance: 3485aec1-ef02-4c1f-97a0-ea5377a95616] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:27:51.353721 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:51.354113 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:51.475052 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] [instance: 3485aec1-ef02-4c1f-97a0-ea5377a95616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:27:51.477394 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:51.477802 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:51.764825 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:51.766197 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b1a68a68-ce2e-4adb-938a-54147868fa07 tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:55.507881 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-89b1fea9-602d-4dbd-b08a-e3b444e8c531 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:27:55.512852 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b1fea9-602d-4dbd-b08a-e3b444e8c531 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:55.513552 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b1fea9-602d-4dbd-b08a-e3b444e8c531 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:55.620750 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-89b1fea9-602d-4dbd-b08a-e3b444e8c531 tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: 16bc83f4-0165-4b0f-ae0f-4b93f6744469] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:27:59.024420 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:27:59.049610 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.049860 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:59.382877 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.383040 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:59.383814 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.384582 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:59.404747 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Getting quotas for project a3788d0cda954ecfb2112a24f29d6e2d. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:27:59.411026 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Getting quotas for user 2aca2b1ee360465bb29df2c44bea1685 and project a3788d0cda954ecfb2112a24f29d6e2d. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:27:59.420762 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] [instance: 6a8c9f53-f5ed-4c45-9e77-e731fe9d4185] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:27:59.433390 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.433795 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:59.509658 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] [instance: 6a8c9f53-f5ed-4c45-9e77-e731fe9d4185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='06a97698-5db1-4fb2-a769-457fabe84efc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:27:59.511260 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.511686 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:59.794685 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.795012 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35f4a9fd-68e2-4d30-b118-f7a9f859ea17 tempest-AttachSCSIVolumeTestJSON-237189725 tempest-AttachSCSIVolumeTestJSON-237189725-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:27:59.935971 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-75ad85a3-46e7-4ef8-b43b-c99787118a5b tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:27:59.936477 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-75ad85a3-46e7-4ef8-b43b-c99787118a5b tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:27:59.936839 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-75ad85a3-46e7-4ef8-b43b-c99787118a5b tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:00.080503 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-75ad85a3-46e7-4ef8-b43b-c99787118a5b tempest-ServerShowV254Test-456723964 tempest-ServerShowV254Test-456723964-project] [instance: 3485aec1-ef02-4c1f-97a0-ea5377a95616] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:28:04.729825 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:28:04.805026 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:04.807245 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:05.119762 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:05.120656 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:05.121795 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:05.122585 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:05.152359 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Getting quotas for project 02b72099f53d46af8bbade31ee00b2b8. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:28:05.173376 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Getting quotas for user 4b51dc172d1f45168ca953e893ef7326 and project 02b72099f53d46af8bbade31ee00b2b8. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:28:05.213723 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] [instance: 09e57626-2148-4341-9ced-6fe4cfc1f7ea] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:28:05.215835 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:05.217308 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:05.320056 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] [instance: 09e57626-2148-4341-9ced-6fe4cfc1f7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:28:05.321851 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:05.322634 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:05.597003 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:05.597647 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3821c2c9-8de5-4d12-9c31-42a5fa27baea tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:27.363998 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:28:28.373701 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54900. Apr 18 20:28:29.082601 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:28:29.136129 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:29.136712 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:29.327203 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:29.335616 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:29.336734 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:29.337251 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:29.368423 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Getting quotas for project 28ed74ee7a9441aea7580e3b9802dd04. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:28:29.379193 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Getting quotas for user adf3450fbf6f4735a4559e0857b4ffff and project 28ed74ee7a9441aea7580e3b9802dd04. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:28:29.390588 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: c85b4299-eb93-497f-ade1-1a684a084a99] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:28:29.391705 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:29.392309 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:29.519378 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] [instance: c85b4299-eb93-497f-ade1-1a684a084a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:28:29.520990 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:29.521666 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:29.796774 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:29.798935 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5c7433ad-2642-4e21-b4dc-bd534030809d tempest-ServerDiskConfigTestJSON-25167839 tempest-ServerDiskConfigTestJSON-25167839-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:34.336008 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:28:34.383437 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:34.384178 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:34.648658 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:34.650143 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:34.652324 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:34.654777 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:34.686570 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Getting quotas for project 997ce06ca6a4444e84cf900c18564a29. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:28:34.688256 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Getting quotas for user 31e99aeecee14082b128cfcbc40d70cb and project 997ce06ca6a4444e84cf900c18564a29. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:28:34.720216 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] [instance: 39a6c655-a87a-4117-9726-c42f80deb71c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:28:34.721151 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:34.721659 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:34.825192 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] [instance: 39a6c655-a87a-4117-9726-c42f80deb71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:28:34.826871 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:34.827751 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:35.239135 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:35.239725 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3977a400-0963-4bee-b448-e5a5639142cd tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:41.779753 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1dcf527e-4222-45ed-b086-20fc2d8befeb tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:28:41.782221 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1dcf527e-4222-45ed-b086-20fc2d8befeb tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:41.782689 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1dcf527e-4222-45ed-b086-20fc2d8befeb tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:41.860184 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1dcf527e-4222-45ed-b086-20fc2d8befeb tempest-ServersAdmin275Test-1957041394 tempest-ServersAdmin275Test-1957041394-project] [instance: 39a6c655-a87a-4117-9726-c42f80deb71c] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:28:53.897738 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:28:53.924949 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:53.925246 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:54.135577 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:54.135989 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:54.136764 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:54.137190 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:54.153601 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Getting quotas for project 02b72099f53d46af8bbade31ee00b2b8. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:28:54.158754 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Getting quotas for user 4b51dc172d1f45168ca953e893ef7326 and project 02b72099f53d46af8bbade31ee00b2b8. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:28:54.169069 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] [instance: 622848b5-b331-4ab1-aa32-b3d21a7cb514] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:28:54.169983 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:54.170379 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:54.261119 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] [instance: 622848b5-b331-4ab1-aa32-b3d21a7cb514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:28:54.262523 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:54.262921 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:28:54.507447 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:28:54.507859 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f4832fc4-e13e-4be8-a704-f4f235619747 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:10.187503 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Took 1.55 seconds to select destinations for 2 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:29:10.266168 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:10.266168 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:10.699042 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:10.699042 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:10.916871 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:10.917306 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:10.918002 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:10.918386 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:10.939386 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Getting quotas for project 75af1a24e8a04c9fb0c487c50abd9c46. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:29:10.943927 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Getting quotas for user 517c5766d933428682aff888f4a6b399 and project 75af1a24e8a04c9fb0c487c50abd9c46. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:29:10.956195 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: 0226434d-6cb1-4c30-8774-d7888f4b4ab6] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:29:10.957382 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:10.957773 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:11.133176 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: 0226434d-6cb1-4c30-8774-d7888f4b4ab6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:29:11.133176 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:11.136585 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:11.649280 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:11.649280 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:11.670638 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: 520b03b2-edb7-4091-8f2e-1bfb81ae4728] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:29:11.672012 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:11.672402 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:11.800982 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: 520b03b2-edb7-4091-8f2e-1bfb81ae4728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:29:11.802242 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:11.802649 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:12.163967 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:12.164683 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0faac559-a088-4d29-a386-caf792edcb27 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:13.679034 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b77c2db1-c45b-4e8d-a628-1b89b8ba490c tempest-ServersAdmin275Test-2128106934 tempest-ServersAdmin275Test-2128106934-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:29:13.680836 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b77c2db1-c45b-4e8d-a628-1b89b8ba490c tempest-ServersAdmin275Test-2128106934 tempest-ServersAdmin275Test-2128106934-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:13.683562 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b77c2db1-c45b-4e8d-a628-1b89b8ba490c tempest-ServersAdmin275Test-2128106934 tempest-ServersAdmin275Test-2128106934-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:13.801322 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b77c2db1-c45b-4e8d-a628-1b89b8ba490c tempest-ServersAdmin275Test-2128106934 tempest-ServersAdmin275Test-2128106934-project-admin] [instance: 39a6c655-a87a-4117-9726-c42f80deb71c] No migration record for the rebuild/evacuate request. {{(pid=94973) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:29:13.804353 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b77c2db1-c45b-4e8d-a628-1b89b8ba490c tempest-ServersAdmin275Test-2128106934 tempest-ServersAdmin275Test-2128106934-project-admin] [37232b48-77d3-4120-bcc4-cd0f7c85d90a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 18 20:29:14.813979 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [None req-b77c2db1-c45b-4e8d-a628-1b89b8ba490c tempest-ServersAdmin275Test-2128106934 tempest-ServersAdmin275Test-2128106934-project-admin] [37232b48-77d3-4120-bcc4-cd0f7c85d90a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56382. Apr 18 20:29:26.749864 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:29:26.791471 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:26.792445 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:26.928866 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:26.929498 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:26.930422 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:26.930973 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:26.947544 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Getting quotas for project 02b72099f53d46af8bbade31ee00b2b8. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:29:26.952720 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Getting quotas for user 4b51dc172d1f45168ca953e893ef7326 and project 02b72099f53d46af8bbade31ee00b2b8. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:29:26.964832 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] [instance: d04cf1cc-7fb5-4ab2-b61b-260c03c6bef0] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:29:26.965927 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:26.966333 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:27.037331 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] [instance: d04cf1cc-7fb5-4ab2-b61b-260c03c6bef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:29:27.045938 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:27.045938 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:27.435630 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:27.436094 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-005904a0-8469-439a-9646-8d5db87e3766 tempest-ImagesOneServerNegativeTestJSON-1575534762 tempest-ImagesOneServerNegativeTestJSON-1575534762-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:36.782883 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Took 1.15 seconds to select destinations for 2 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:29:36.845637 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:36.846037 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.113157 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.113785 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.341937 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.342714 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.343054 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.343660 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.379362 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Getting quotas for project 75af1a24e8a04c9fb0c487c50abd9c46. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:29:37.386183 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Getting quotas for user 517c5766d933428682aff888f4a6b399 and project 75af1a24e8a04c9fb0c487c50abd9c46. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:29:37.401237 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: eaf2cd75-940f-43f5-a7dc-a41f4e9e5d5c] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:29:37.402815 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.403452 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.573382 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: eaf2cd75-940f-43f5-a7dc-a41f4e9e5d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:29:37.574903 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.575567 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.940431 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.943557 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:37.958192 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: df8bc392-1485-4cb9-bde6-74d62ed45ecd] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:29:37.961765 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:37.961996 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:38.064883 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] [instance: df8bc392-1485-4cb9-bde6-74d62ed45ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:29:38.069513 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:38.070124 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:38.484327 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:38.484327 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-472c78bb-5431-4dd5-a1e3-f559a6869836 tempest-MultipleCreateTestJSON-1557014978 tempest-MultipleCreateTestJSON-1557014978-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:50.697722 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:29:50.724464 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:50.724464 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:51.054411 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:51.055132 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:51.056186 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:51.056478 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:51.079795 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:29:51.086194 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for user c69e6371d77f4e33a89fde546dd3076c and project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:29:51.105683 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 83d72497-ce98-427f-9eaf-0efc0922950d] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:29:51.107262 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:51.107931 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:51.189271 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 83d72497-ce98-427f-9eaf-0efc0922950d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:29:51.190524 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:51.191052 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:29:51.728712 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:29:51.729758 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9c94a1d4-15c5-445f-a681-2555330109f0 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:02.491045 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:30:02.541371 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:02.541776 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:02.779844 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:02.780315 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:02.781316 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:02.782133 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:02.830387 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Getting quotas for project ba3c3aaa100044d3ae1fec4c02a784f5. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:30:02.841195 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Getting quotas for user f3a1d2d3194b4b2abc9d94ef74502841 and project ba3c3aaa100044d3ae1fec4c02a784f5. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:30:02.885002 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: ca2bb22f-3b35-4634-a1c1-2e7095ab388f] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:30:02.885957 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:02.886357 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:03.060150 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: ca2bb22f-3b35-4634-a1c1-2e7095ab388f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:30:03.061408 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:03.061870 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:03.519742 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:03.521411 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a7c7a30d-bc68-476b-a09c-e02f563a8bdf tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:03.686655 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:30:03.723315 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:03.723900 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:03.890992 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:03.891456 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:03.892173 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:03.892559 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:03.916660 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Getting quotas for project ba3c3aaa100044d3ae1fec4c02a784f5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:30:03.922738 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Getting quotas for user f3a1d2d3194b4b2abc9d94ef74502841 and project ba3c3aaa100044d3ae1fec4c02a784f5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:30:03.937931 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: b282e44e-2c29-4374-87c1-92f5e506034b] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:30:03.939292 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:03.940121 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:04.077944 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: b282e44e-2c29-4374-87c1-92f5e506034b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:30:04.079678 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:04.079678 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:04.502965 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:04.504025 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7c0a09b4-cf21-4ec0-ad11-aded0b7fa393 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:14.516606 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:30:14.612181 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:14.612901 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:14.877176 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:14.877575 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:14.880220 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:14.880913 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:14.919051 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Getting quotas for project f4f2afb6a280450f9056dba84dfa5594. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:30:14.933137 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Getting quotas for user 1a35370afc504d979c80e6c8617819bf and project f4f2afb6a280450f9056dba84dfa5594. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:30:14.949898 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] [instance: db78c120-d65e-4640-a0fb-408cae3a9222] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:30:14.950953 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:14.951453 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:15.059302 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] [instance: db78c120-d65e-4640-a0fb-408cae3a9222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:30:15.061224 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:15.061634 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:15.346420 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:15.347018 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-41e12b06-6013-4c7f-9db9-53f6487b2d24 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:29.369744 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:30:29.405674 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:29.406393 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:29.571361 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:29.575969 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:29.575969 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:29.575969 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:29.595680 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Getting quotas for project ba3c3aaa100044d3ae1fec4c02a784f5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:30:29.602252 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Getting quotas for user f3a1d2d3194b4b2abc9d94ef74502841 and project ba3c3aaa100044d3ae1fec4c02a784f5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:30:29.612716 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: 2a946e9d-382a-4f1d-814b-9a7e4fd16e62] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:30:29.614122 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:29.614846 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:29.765084 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: 2a946e9d-382a-4f1d-814b-9a7e4fd16e62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:30:29.770638 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:29.771788 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:29.777675 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:30:29.854136 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:29.854551 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:30.231964 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:30.231964 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8720e21c-837e-4e40-af43-5b3de8f7032f tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:30.288640 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:30.296384 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:30.296384 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:30.296384 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:30.377515 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Getting quotas for project 0b294183377e4c19ae41e4cb6b3a2aa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:30:30.395984 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Getting quotas for user 21ebbab7a9624728a5a3506558cbecca and project 0b294183377e4c19ae41e4cb6b3a2aa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:30:30.445685 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] [instance: 6da1461f-83e5-4aa4-8cff-038a0dffebcd] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:30:30.446592 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:30.447038 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:30.607621 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] [instance: 6da1461f-83e5-4aa4-8cff-038a0dffebcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:30:30.609836 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:30.610325 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:30.934678 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:30:30.936306 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b5e2f8a8-7686-43a5-8876-1c14f501f06a tempest-ServerPasswordTestJSON-711786430 tempest-ServerPasswordTestJSON-711786430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:30:35.182038 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:30:36.193431 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58708. Apr 18 20:31:03.184346 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:31:03.262378 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:03.262792 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:03.498097 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:03.498944 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:03.500859 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:03.501462 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:03.530246 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Getting quotas for project f4f2afb6a280450f9056dba84dfa5594. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:31:03.547824 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Getting quotas for user 1a35370afc504d979c80e6c8617819bf and project f4f2afb6a280450f9056dba84dfa5594. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:31:03.569307 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] [instance: 0063bb98-d83e-4175-962d-f89645d2d703] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:31:03.571656 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:03.572813 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:03.661802 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] [instance: 0063bb98-d83e-4175-962d-f89645d2d703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:31:03.665648 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:03.666286 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:04.034996 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:04.036711 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2d2ab0bf-6947-49e1-8b03-fa024475cbc1 tempest-SecurityGroupsTestJSON-1983052351 tempest-SecurityGroupsTestJSON-1983052351-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:09.947526 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9fd9bbe5-24b5-42f0-b937-03900381982b tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:31:09.948190 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9fd9bbe5-24b5-42f0-b937-03900381982b tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:09.948412 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9fd9bbe5-24b5-42f0-b937-03900381982b tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:09.971965 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Took 0.99 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:31:10.033486 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:10.040751 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:10.060998 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9fd9bbe5-24b5-42f0-b937-03900381982b tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: ca2bb22f-3b35-4634-a1c1-2e7095ab388f] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:31:10.064285 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9fd9bbe5-24b5-42f0-b937-03900381982b tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [fed22751-a96e-475e-86e4-462c485e4dc9] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 18 20:31:10.327599 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:10.328232 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:10.329127 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:10.329662 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:10.353737 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Getting quotas for project 1d6f3a415aff4f26b34d9426b03ec8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:31:10.360413 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Getting quotas for user ac6fa986cbe54182baf0e22965608f13 and project 1d6f3a415aff4f26b34d9426b03ec8c6. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:31:10.373067 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] [instance: 17774e34-4bae-4ed3-ac2d-1a1668e0d999] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:31:10.374764 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:10.375450 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:10.447225 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] [instance: 17774e34-4bae-4ed3-ac2d-1a1668e0d999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:31:10.449086 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:10.449648 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:10.827136 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:10.827827 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9072754-a939-4777-98bf-fb30fdab2425 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:11.074617 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [None req-9fd9bbe5-24b5-42f0-b937-03900381982b tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [fed22751-a96e-475e-86e4-462c485e4dc9] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59444. Apr 18 20:31:19.714937 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:31:19.753446 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:19.754678 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:20.104506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:20.104506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:20.105422 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:20.105422 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:20.124929 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Getting quotas for project 3ad6f2adccda409da2bf70af78304518. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:31:20.130019 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Getting quotas for user 41652612a68945a1a529f8c8a81ed7da and project 3ad6f2adccda409da2bf70af78304518. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:31:20.142784 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] [instance: 3e9c0cb1-223f-490d-b86e-05dc93f0dbc8] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:31:20.143719 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:20.145212 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:20.237114 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1c283403-3e6c-4c15-8d71-4934b3f34f54 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:31:20.237684 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1c283403-3e6c-4c15-8d71-4934b3f34f54 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:20.238008 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1c283403-3e6c-4c15-8d71-4934b3f34f54 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:20.286683 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] [instance: 3e9c0cb1-223f-490d-b86e-05dc93f0dbc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:31:20.287993 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:20.290793 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:20.396734 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1c283403-3e6c-4c15-8d71-4934b3f34f54 tempest-ServerShowV257Test-212631895 tempest-ServerShowV257Test-212631895-project] [instance: 17774e34-4bae-4ed3-ac2d-1a1668e0d999] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:31:20.723760 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:20.724236 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ccd289cf-8e27-478c-9f2b-e6dfffadecb7 tempest-VolumesAdminNegativeTest-122985957 tempest-VolumesAdminNegativeTest-122985957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:28.375808 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:31:29.405636 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59812. Apr 18 20:31:49.458255 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-cf54cbb6-5dce-4ca2-86e1-649620570c24 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:31:49.459652 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb6-5dce-4ca2-86e1-649620570c24 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:31:49.461705 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-cf54cbb6-5dce-4ca2-86e1-649620570c24 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:31:49.599492 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-cf54cbb6-5dce-4ca2-86e1-649620570c24 tempest-ServersAdminTestJSON-1064623915 tempest-ServersAdminTestJSON-1064623915-project] [instance: ca2bb22f-3b35-4634-a1c1-2e7095ab388f] No migration record for the rebuild/evacuate request. {{(pid=94973) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:32:07.426846 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:32:07.483184 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:07.483874 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:07.705838 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:07.706699 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:07.707607 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:07.708150 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:07.727951 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:32:07.736159 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for user c69e6371d77f4e33a89fde546dd3076c and project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:32:07.759213 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 2d5b5ca1-3cd1-4820-9880-28a3eb13d046] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:32:07.760830 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:07.761095 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:07.859938 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 2d5b5ca1-3cd1-4820-9880-28a3eb13d046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:32:07.872061 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:07.872061 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:08.170925 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:08.171426 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-aa2706b6-2190-4eb3-815d-2423d1efd753 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:39.805252 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:32:39.881051 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:39.881968 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:40.318379 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:40.319005 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:40.320020 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:40.320631 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:40.361190 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:32:40.368553 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for user 90df955994be424596efea67b324daa2 and project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:32:40.386381 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 03a0aaf5-d309-4e13-9a9a-a1049e183b00] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:32:40.387368 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:40.387766 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:40.455118 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 03a0aaf5-d309-4e13-9a9a-a1049e183b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:32:40.460540 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:40.464151 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:40.850159 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:40.850972 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-59a97a32-c15b-415d-a975-44c567440e8a tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:41.518950 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:32:41.573420 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:41.575316 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:42.011777 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:42.020014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:42.020014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:42.020014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:42.061226 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:32:42.076022 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for user 8bdfe903acfa424a9e6377a98151994d and project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:32:42.108601 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: d174ca7d-cc74-4aa8-a9c0-a1c4c124821e] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:32:42.110846 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:42.111277 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:42.218759 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: d174ca7d-cc74-4aa8-a9c0-a1c4c124821e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:32:42.220132 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:42.220577 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:42.684370 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:42.684895 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a118fd72-aac6-4258-beb9-2b904b3be2c5 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:58.136162 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:32:58.179520 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:58.179920 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:58.505756 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:58.506610 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:58.508282 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:58.509053 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:58.564215 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Getting quotas for project 209ec30929ea4a8cbe1b9ced18432ccf. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:32:58.570626 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Getting quotas for user cfaa6019425f4bd38db2918e2d48dc70 and project 209ec30929ea4a8cbe1b9ced18432ccf. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:32:58.588598 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] [instance: ce3200ca-c2ba-4a75-a459-2e00166ab451] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:32:58.588598 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:58.588598 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:58.723974 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] [instance: ce3200ca-c2ba-4a75-a459-2e00166ab451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:32:58.725813 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:58.726375 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:32:59.121679 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:32:59.121679 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c559aad2-ad36-48b3-a333-e6eadda7babd tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:04.398039 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:33:04.443755 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:04.444380 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:04.609173 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:04.609640 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:04.614464 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:04.614894 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:04.636355 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:33:04.641047 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for user c69e6371d77f4e33a89fde546dd3076c and project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:33:04.652525 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 8b8ed778-1f8a-40d2-b11d-9e5522f06595] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:33:04.653650 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:04.654231 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:04.734853 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 8b8ed778-1f8a-40d2-b11d-9e5522f06595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:33:04.736228 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:04.736621 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:05.007349 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:05.007994 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-a361b9f6-4779-46e7-a548-01ed9207b05b tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:07.102447 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:33:07.128551 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:07.129308 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:07.390848 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:07.391575 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:07.392477 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:07.393016 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:07.412526 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:33:07.418377 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for user b0ef15db06304241ab10fd8c1736f84d and project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:33:07.444180 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 74ddff0f-f6be-4833-bc18-7f7dcc8dc864] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:33:07.444180 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:07.444180 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:07.517375 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 74ddff0f-f6be-4833-bc18-7f7dcc8dc864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:33:07.518636 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:07.519086 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:07.792239 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:07.792670 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2c71e043-5ea8-42df-a0b8-e49602b4de76 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:36.192822 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:33:37.215190 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33910. Apr 18 20:33:38.811845 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:38.812451 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:39.744749 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Took 0.87 seconds to select destinations for 2 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:33:39.785419 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:39.788987 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:39.979412 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:39.980114 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.144543 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.145469 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.146348 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.146897 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.165871 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:33:40.172755 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for user b0ef15db06304241ab10fd8c1736f84d and project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:33:40.191949 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: f3068b9d-ed9c-49a9-937c-dcd6afadb658] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:33:40.194628 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.195427 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.259303 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: f3068b9d-ed9c-49a9-937c-dcd6afadb658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:33:40.260852 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.261404 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.675009 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.675613 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.694817 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: d6ba85df-83b9-482b-b223-245c8273191d] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:33:40.695725 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance_group [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lazy-loading 'hosts' on InstanceGroup uuid b55a356c-648e-41ae-b80a-fcf24b5aa8e1 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Apr 18 20:33:40.724881 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.725319 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:40.832062 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: d6ba85df-83b9-482b-b223-245c8273191d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:33:40.834867 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:40.834867 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:41.057583 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:41.059176 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-d44d775f-ade9-4047-9393-63957fd44b66 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:41.340460 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:33:41.391832 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:41.392309 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:41.647969 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:41.650067 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:41.651487 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:41.665505 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:41.712989 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:33:41.718347 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for user 90df955994be424596efea67b324daa2 and project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:33:41.745846 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 2f479d95-6e6d-4f2e-a1cf-dc1e5b2ec169] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:33:41.746860 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:41.747302 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:41.824733 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 2f479d95-6e6d-4f2e-a1cf-dc1e5b2ec169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:33:41.830996 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:41.832598 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:33:42.117356 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:33:42.118714 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a41bf7e7-c507-42b8-8280-883f16257254 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:14.725501 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:34:14.772135 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:14.772615 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:14.971646 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:14.972294 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:14.973216 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:14.973878 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:15.009046 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:34:15.017474 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for user 8bdfe903acfa424a9e6377a98151994d and project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:34:15.040425 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: 5e9decac-fae2-4cd2-a1f3-f5efad1bfe9e] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:34:15.043535 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:15.044140 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:15.131204 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: 5e9decac-fae2-4cd2-a1f3-f5efad1bfe9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:34:15.132834 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:15.133448 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:15.445784 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:15.446174 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f2dd8c11-c628-4f20-a632-e9e531622c51 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:17.413801 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:17.414289 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:18.443159 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:34:18.551094 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:18.551485 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:18.630316 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Took 1.12 seconds to select destinations for 2 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:34:18.703844 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:18.703844 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:18.741780 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:18.742178 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:18.749496 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:18.750094 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:18.854289 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Getting quotas for project 209ec30929ea4a8cbe1b9ced18432ccf. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:34:18.880368 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Getting quotas for user cfaa6019425f4bd38db2918e2d48dc70 and project 209ec30929ea4a8cbe1b9ced18432ccf. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:34:18.900585 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] [instance: 6c23c34f-181f-406f-bf63-094fae05ee33] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:34:18.902224 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:18.902847 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:18.982188 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] [instance: 6c23c34f-181f-406f-bf63-094fae05ee33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:34:18.984463 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:18.985213 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.116821 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.117409 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.275679 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.276218 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b2036b4e-9dbd-4f81-a436-b5113eb76279 tempest-ServersTestMultiNic-412685138 tempest-ServersTestMultiNic-412685138-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.331028 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.331953 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.336243 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.347489 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.384005 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:34:19.395426 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for user b0ef15db06304241ab10fd8c1736f84d and project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:34:19.416524 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 609c2e5f-d3d1-48ef-a935-90f41d580841] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:34:19.423603 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.424166 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.526771 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 609c2e5f-d3d1-48ef-a935-90f41d580841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:34:19.527986 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.528385 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.836912 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.837990 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.853194 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: d53095ac-c555-44b3-ae52-bceebd7d9ca9] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:34:19.853927 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance_group [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lazy-loading 'hosts' on InstanceGroup uuid aa63b4ec-3333-4917-a3fa-08c7d9d48981 {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Apr 18 20:34:19.874635 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.875381 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:19.961235 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: d53095ac-c555-44b3-ae52-bceebd7d9ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:34:19.962453 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:19.962857 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:20.367031 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:20.367466 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1d9ddb4a-355e-4ffd-a395-3e915e3e8038 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:27.122262 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:34:29.387595 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:34:30.403691 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 34848. Apr 18 20:34:35.676979 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:34:56.961816 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:34:57.021422 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:57.024408 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:57.423429 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:57.424228 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:57.425358 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:57.425971 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:57.455528 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:34:57.464167 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for user b0ef15db06304241ab10fd8c1736f84d and project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:34:57.475660 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 238b0664-1b01-4c1a-87d3-10f36fd90baa] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:34:57.477008 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:57.477933 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:57.604538 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 238b0664-1b01-4c1a-87d3-10f36fd90baa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:34:57.620233 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:57.621916 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:34:57.936928 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:34:57.939142 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-01bf607a-ac38-40c0-80fe-43111b75965d tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:10.300967 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:35:10.361059 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:10.361476 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:10.645471 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:10.645898 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:10.646754 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:10.660566 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:10.704893 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Getting quotas for project 31b894862fb7480ea25920e8bcef9940. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:35:10.710198 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Getting quotas for user 195e27f3f25446b6ba8191eac27d0841 and project 31b894862fb7480ea25920e8bcef9940. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:35:10.735115 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] [instance: 32119bba-f308-4186-befb-c823d3d7bd7e] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:35:10.736084 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:10.736596 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:10.952047 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] [instance: 32119bba-f308-4186-befb-c823d3d7bd7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:35:10.953633 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:10.959458 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:11.217503 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:11.217942 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b38686cd-15d5-440f-9382-c68e47ee9cb1 tempest-InstanceActionsV221TestJSON-1623492261 tempest-InstanceActionsV221TestJSON-1623492261-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:18.505666 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:35:18.534078 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:18.534488 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:18.703860 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:18.704481 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:18.705357 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:18.705896 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:18.723660 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:35:18.728840 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for user 90df955994be424596efea67b324daa2 and project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:35:18.741377 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 885471c8-a243-44be-980f-efe50a91c18a] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:35:18.742631 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:18.743206 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:18.845686 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 885471c8-a243-44be-980f-efe50a91c18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:35:18.848101 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:18.848607 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:19.096747 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:19.097234 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3d56346c-8c2a-4def-bf5b-4e43b409ba84 tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:26.709400 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:35:26.732402 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:26.733264 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:26.847768 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:26.848869 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:26.850036 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:26.850715 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:26.899237 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:35:26.908354 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for user b0ef15db06304241ab10fd8c1736f84d and project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:35:26.925488 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 8325957c-d457-45b4-8aa6-31cdfa8290e3] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:35:26.926680 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:26.927782 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:27.057191 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: 8325957c-d457-45b4-8aa6-31cdfa8290e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:35:27.060760 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:27.061478 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:27.332734 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:27.333432 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7e33edf9-4491-49e8-91d7-fa8f41ac55c5 tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:41.397796 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:35:41.423455 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:41.424550 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:41.606263 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:41.609506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:41.612715 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:41.613184 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:41.649772 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:35:41.657263 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for user c69e6371d77f4e33a89fde546dd3076c and project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:35:41.674079 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 7253dd39-9aaf-433a-b6ee-1c2efd9b8743] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:35:41.675210 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:41.675694 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:41.765774 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 7253dd39-9aaf-433a-b6ee-1c2efd9b8743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:35:41.767712 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:41.768352 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:42.084584 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:42.085046 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1f1950a4-9ed7-423e-b12f-bf8ec1900c81 tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:52.261765 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:35:52.284905 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:52.285573 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:52.419096 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:52.419854 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:52.420669 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:52.421156 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:52.443758 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:35:52.448346 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Getting quotas for user b0ef15db06304241ab10fd8c1736f84d and project 74305065427c4c0aabfca37e0ad9a749. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:35:52.459709 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: ded0aa33-712c-4ca0-a013-7788e4a9cb00] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:35:52.460743 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:52.461203 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:52.529722 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] [instance: ded0aa33-712c-4ca0-a013-7788e4a9cb00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:35:52.531318 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:52.531910 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:52.791854 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:52.792905 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f394d934-6f79-40ee-bd28-d1f81e02506e tempest-ServersOnMultiNodesTest-610521241 tempest-ServersOnMultiNodesTest-610521241-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:53.556977 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:53.556977 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:54.342906 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:35:54.392628 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:54.393041 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:54.659556 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:54.660177 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:54.663943 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:54.664385 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:54.705958 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Getting quotas for project dec6a4aece604af383fb8f3e039d7b1a. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:35:54.713740 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Getting quotas for user a280f0ca20d6480db3ec7f186e1aae96 and project dec6a4aece604af383fb8f3e039d7b1a. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:35:54.730278 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] [instance: b9e9ee82-b0b7-430f-9d3a-245d0cca7752] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:35:54.731455 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:54.734265 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:54.792662 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] [instance: b9e9ee82-b0b7-430f-9d3a-245d0cca7752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:35:54.794293 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:54.794293 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:35:55.015647 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:35:55.016432 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-253f6bb7-00c6-4a66-bf46-0df946259d0e tempest-ServerGroupTestJSON-1117598479 tempest-ServerGroupTestJSON-1117598479-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:03.069929 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:36:03.139395 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:03.139799 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:03.421351 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:03.422232 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:03.423467 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:03.424131 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:03.462616 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Getting quotas for project edf4e8a561c6445f919a5087ee81aade. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:36:03.469755 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Getting quotas for user f0bcb0d941de4b68bc3a3f501dc3dcf9 and project edf4e8a561c6445f919a5087ee81aade. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:36:03.496493 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] [instance: 51019f8a-59bf-4a3a-9cfc-f7b15377eda3] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:36:03.497550 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:03.498028 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:03.582250 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] [instance: 51019f8a-59bf-4a3a-9cfc-f7b15377eda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:36:03.583747 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:03.584870 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:03.810641 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:03.810641 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e004fd3e-fe9b-4791-84d1-ab28e715c551 tempest-ServerMetadataNegativeTestJSON-1183513246 tempest-ServerMetadataNegativeTestJSON-1183513246-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:16.035545 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:36:16.090276 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:16.091604 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:16.214334 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:16.216082 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:16.216831 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:16.217224 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:16.247888 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:36:16.255680 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Getting quotas for user c69e6371d77f4e33a89fde546dd3076c and project 6869b6d02478429a997c28c8073147a5. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:36:16.268040 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 11f01845-de06-4fbd-bea7-da9e0d5c6a79] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:36:16.269342 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:16.269889 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:16.317710 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] [instance: 11f01845-de06-4fbd-bea7-da9e0d5c6a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:36:16.319334 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:16.319898 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:16.924163 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:16.924163 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f464dc69-de7c-48d8-8cf2-8096ade9467a tempest-ServerActionsTestJSON-902545430 tempest-ServerActionsTestJSON-902545430-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:26.837049 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:36:26.875058 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:26.880343 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:27.020028 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:27.020716 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:27.021697 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:27.022713 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:27.043911 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:36:27.048612 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Getting quotas for user 90df955994be424596efea67b324daa2 and project 0de80475197d424c87d1dbec32f1bfa9. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:36:27.061609 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 1451b1c9-dbf9-40c7-b7a6-3cbfed8c972c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:36:27.063517 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:27.064086 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:27.186399 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] [instance: 1451b1c9-dbf9-40c7-b7a6-3cbfed8c972c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:36:27.188129 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:27.188695 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:27.500270 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:27.500970 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c6e42c22-320c-4f94-b991-221cefec891f tempest-ImagesTestJSON-649472542 tempest-ImagesTestJSON-649472542-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:37.210983 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:36:38.219936 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37310. Apr 18 20:36:46.527663 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:36:46.575363 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:46.575926 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:46.879619 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:46.881071 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:46.882173 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:46.882946 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:46.902664 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Getting quotas for project 608c0b4f549c4d4187c59234a5d0b374. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:36:46.908222 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Getting quotas for user 8f8d6127ba36451d8b086297e14d9a1b and project 608c0b4f549c4d4187c59234a5d0b374. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:36:46.929748 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] [instance: 751188b6-c1c2-46d7-b664-158b651e4a81] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:36:46.932337 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:46.933142 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:47.002605 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] [instance: 751188b6-c1c2-46d7-b664-158b651e4a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:36:47.004486 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:47.004988 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:47.451003 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:47.452560 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0e3853cb-c067-427b-b048-52ce3af7e03b tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:48.028926 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:36:48.075037 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:48.076029 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:48.256570 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:48.257385 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:48.258893 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:48.259926 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:48.286319 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Getting quotas for project 608c0b4f549c4d4187c59234a5d0b374. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:36:48.296679 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Getting quotas for user 8f8d6127ba36451d8b086297e14d9a1b and project 608c0b4f549c4d4187c59234a5d0b374. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:36:48.324422 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] [instance: e75ac8a7-5d1c-4b72-b284-e21c2e4b6553] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:36:48.328676 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:48.332068 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:48.421271 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] [instance: e75ac8a7-5d1c-4b72-b284-e21c2e4b6553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:36:48.423539 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:48.423957 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:48.666122 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:48.666532 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-89b0c46b-35d3-4589-86ca-89f518aaa448 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:59.416342 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:36:59.469521 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:59.472670 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:59.798934 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:59.799377 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:59.807792 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:59.814571 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:36:59.875575 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:36:59.890834 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for user 8bdfe903acfa424a9e6377a98151994d and project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:36:59.934988 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: aaa11b40-4b89-4c02-8e03-febfb3d541c7] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:36:59.935970 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:36:59.936365 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:00.102242 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: aaa11b40-4b89-4c02-8e03-febfb3d541c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:37:00.107024 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:00.107816 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:00.263891 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-baa07360-7ac3-497a-ada7-c68520368068 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:37:00.264575 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-baa07360-7ac3-497a-ada7-c68520368068 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:00.265171 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-baa07360-7ac3-497a-ada7-c68520368068 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:00.601086 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-baa07360-7ac3-497a-ada7-c68520368068 tempest-ServerShowV247Test-1239177263 tempest-ServerShowV247Test-1239177263-project] [instance: e75ac8a7-5d1c-4b72-b284-e21c2e4b6553] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 20:37:00.608565 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:00.609069 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a1b15cf2-858d-4199-aa75-43810b0814e2 tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:06.433772 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:37:06.527464 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:06.527464 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:06.793517 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:06.794648 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:06.799989 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:06.799989 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:06.839620 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Getting quotas for project 1fdaf517ce0d487ba19976dbc932440a. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:37:06.854910 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Getting quotas for user ebefa6508a864da489439aae3dbd3fd6 and project 1fdaf517ce0d487ba19976dbc932440a. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:37:06.882907 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] [instance: e89d1306-a60b-4502-b526-0ae55f413e8c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:37:06.885292 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:06.892376 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:06.967675 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] [instance: e89d1306-a60b-4502-b526-0ae55f413e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:37:06.969153 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:06.969706 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:07.266751 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:37:07.267692 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a9934b42-95d8-406e-819b-23aa695a257f tempest-ServersNegativeTestMultiTenantJSON-286282404 tempest-ServersNegativeTestMultiTenantJSON-286282404-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:37:30.404314 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:37:31.414100 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38470. Apr 18 20:37:47.134204 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:38:03.610944 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:38:03.665123 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:03.667480 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:03.929134 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:03.932766 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:03.938687 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:03.941181 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:04.000860 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:38:04.010534 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:38:04.047347 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: e291515a-4e03-438a-a55b-4b190fec6bd6] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:38:04.048312 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:04.048747 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:04.120496 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: e291515a-4e03-438a-a55b-4b190fec6bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:38:04.121735 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:04.122130 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:04.419884 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:04.420599 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-52f82a23-c011-4b4a-938d-7ab79d6e1afd tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:57.433305 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:38:57.519679 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:57.521271 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:57.720249 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:38:57.753541 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:57.753912 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:57.754887 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:57.756135 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:57.774255 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Getting quotas for project d13d9809c8644396a2bbe61fb586d35f. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:38:57.780146 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Getting quotas for user 21a111415eaa43a090d6e46b9718311c and project d13d9809c8644396a2bbe61fb586d35f. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:38:57.790077 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:57.791285 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:57.797263 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] [instance: 3c24f73c-991b-4026-b996-e8208019d593] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:38:57.797263 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:57.797263 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.222432 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] [instance: 3c24f73c-991b-4026-b996-e8208019d593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:38:58.224211 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.224776 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.314938 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.315387 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.316156 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.321057 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.381826 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:38:58.397859 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:38:58.433569 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: fc1de5ab-19c1-400a-89cd-bdb194033648] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:38:58.438516 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.440014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.507764 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: fc1de5ab-19c1-400a-89cd-bdb194033648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:38:58.509481 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.510160 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.694307 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.697256 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:58.787506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:58.788590 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-2bf88906-7b94-44fa-8237-e3c070421e54 tempest-VolumesBackupsTest-1480369182 tempest-VolumesBackupsTest-1480369182-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:38:59.001765 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:38:59.002863 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-6ff0292a-3a08-4d7e-b175-57a7500a1800 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:01.526490 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Took 0.84 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:39:01.574882 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:01.575304 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:01.913371 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:01.916542 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:01.917350 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:01.924646 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:01.947799 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Getting quotas for project 575edfe16ed74b1bbd333665f06c3220. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:39:01.966312 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Getting quotas for user 48f4c10cb98742a284422ee34772ddd3 and project 575edfe16ed74b1bbd333665f06c3220. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:39:01.993820 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] [instance: abadb0fb-64b9-4612-b6d3-f1570d00806d] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:39:01.994775 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:01.995189 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:02.101620 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] [instance: abadb0fb-64b9-4612-b6d3-f1570d00806d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:39:02.102900 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:02.103325 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:02.478616 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:02.479220 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f3f1b87a-ebf4-411a-bcbd-52d14d63b9f5 tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:04.678189 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:39:04.712005 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:04.712698 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:04.876900 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:04.877299 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:04.878176 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:04.878572 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:04.920287 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:39:04.929629 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:39:04.953109 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: 607405be-f606-49df-9efb-053c8a396cbd] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:39:04.957224 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:04.957224 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:05.159227 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: 607405be-f606-49df-9efb-053c8a396cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:39:05.161865 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:05.161865 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:05.541356 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:05.542062 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-167a048c-76b4-4f9a-9387-f5efe7127a75 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:09.774870 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:39:09.799447 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:09.800200 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:09.980515 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:09.981249 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:09.982345 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:09.982901 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:10.028357 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:39:10.039250 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Getting quotas for user 8bdfe903acfa424a9e6377a98151994d and project f30c828f676c470b8d27cf871772e260. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:39:10.057681 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: bff37a95-188d-4968-a57f-d80c28e78c3b] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:39:10.058904 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:10.059571 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:10.295096 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] [instance: bff37a95-188d-4968-a57f-d80c28e78c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:39:10.296149 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:10.296553 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:10.747511 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:10.747983 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-52ebea29-fcac-44dc-ad79-682bac5e87aa tempest-AttachVolumeNegativeTest-897768622 tempest-AttachVolumeNegativeTest-897768622-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:17.250118 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Took 1.03 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:39:17.291670 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:17.292953 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:17.612109 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:17.612519 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:17.616925 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:17.617344 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:17.685745 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Getting quotas for project 8dc709530124487094b04021c9a557b2. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:39:17.703621 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Getting quotas for user d0902e2e87b740419d31a97e638766c2 and project 8dc709530124487094b04021c9a557b2. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:39:17.736987 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] [instance: 26ede8fe-e9c4-4b65-9ff8-735f03d58624] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:39:17.745579 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:17.746009 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:17.861730 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] [instance: 26ede8fe-e9c4-4b65-9ff8-735f03d58624] block_device_mapping [BlockDeviceMapping(attachment_id=bf24da7c-59b8-4b30-b053-a0a1c241b349,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46672b40-4789-40cc-875b-e56e85d7ff1c',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:39:17.864338 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:17.864746 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:18.179927 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:18.180430 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0aebc840-e19b-4403-a259-1a3ca1be2472 tempest-ServersTestBootFromVolume-1442206408 tempest-ServersTestBootFromVolume-1442206408-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:38.221026 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:39:39.230055 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40730. Apr 18 20:39:40.920895 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:39:40.971798 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:40.971798 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:41.107460 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:41.107873 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:41.108614 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:41.109001 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:41.164244 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:39:41.179801 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:39:41.212333 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: d756d2fc-5675-4d8d-b988-72f9debb81ae] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:39:41.213533 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:41.214455 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:41.351680 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: d756d2fc-5675-4d8d-b988-72f9debb81ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:39:41.353414 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:41.354481 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:41.628632 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:41.636739 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b49ac7f9-bee3-432e-88f5-d1646e7412f0 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:57.475381 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Took 0.85 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:39:57.535517 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:57.535517 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:57.843379 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:57.843791 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:57.844502 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:57.844892 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:57.871087 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Getting quotas for project f2325886d2d04dbda5d5ebafcdc0115a. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:39:57.875884 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Getting quotas for user e034b031b06b4315998ee1dcdc554bdd and project f2325886d2d04dbda5d5ebafcdc0115a. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:39:57.887573 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] [instance: 19db4b6e-87cd-4d40-8146-e75e5e834a47] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:39:57.889103 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:57.889579 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:58.009887 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] [instance: 19db4b6e-87cd-4d40-8146-e75e5e834a47] block_device_mapping [BlockDeviceMapping(attachment_id=f46686c9-4da6-441d-be1a-f4feb34e0a7e,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bb891be6-02c2-417c-94df-66a84db70609',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=798c7654-bb19-43b0-9f5f-738d35382b45,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d9eff10f-e375-49ac-8402-9290b7d2baf0',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=3cb16757-7f5b-4768-9b39-8cfd6d0f9446,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96ec3fc7-65f1-4dce-8446-ad0622b4202a',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:39:58.023165 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:58.023165 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:58.129458 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:58.130406 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:58.262811 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:58.262811 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:39:58.660254 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:39:58.662894 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0f2d5baf-3e1c-4fe6-8acf-81e8d0602133 tempest-TaggedBootDevicesTest_v242-265522874 tempest-TaggedBootDevicesTest_v242-265522874-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:15.952336 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:40:16.027280 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.028101 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.153930 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:40:16.204888 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.205296 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.352792 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.353605 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.359611 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.361421 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.393538 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.393538 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.393538 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.393538 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.397640 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Getting quotas for project de49e15b72cc4f799e77072cb1b062fb. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:40:16.403544 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Getting quotas for user 231cf7e0a0f64d698f54512b54b98572 and project de49e15b72cc4f799e77072cb1b062fb. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:40:16.423172 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] [instance: 64bdcf8c-c6b3-4bfe-b892-dda43da02c13] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:40:16.424555 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.427183 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.431753 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:40:16.439430 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:40:16.451552 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: b861c556-79b5-44dc-97c5-c359661f3e88] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:40:16.452642 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.453036 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.478628 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] [instance: 64bdcf8c-c6b3-4bfe-b892-dda43da02c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:40:16.478774 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.479192 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.522770 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: b861c556-79b5-44dc-97c5-c359661f3e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:40:16.528472 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.528472 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.814165 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.814988 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-49c0ccd3-1dc0-40bd-bf79-53c4ac849d15 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:16.882513 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:16.885293 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-2432218d-4e61-429c-a7aa-c3a36c7ddede tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:31.416544 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:40:32.424549 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41604. Apr 18 20:40:42.190868 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:40:42.225799 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:42.226200 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:42.434672 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:42.435271 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:42.436017 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:42.436411 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:42.452541 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:40:42.457471 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:40:42.468257 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: e10598ee-0388-453f-a7c3-b78f83c10527] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:40:42.469166 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:42.469568 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:42.590963 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: e10598ee-0388-453f-a7c3-b78f83c10527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:40:42.590963 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:42.590963 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:40:42.881966 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:40:42.882353 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bfdb01f3-f934-4549-b77b-6b3c584f8398 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:07.144410 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:41:12.565698 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:41:12.643573 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:12.644471 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:12.880766 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:12.884401 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:12.885414 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:12.886006 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:12.938605 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:41:12.948747 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:41:12.985050 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: 14041015-a43e-4be9-968d-d2d4f72a7743] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:41:12.985050 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:12.985441 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:13.057785 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: 14041015-a43e-4be9-968d-d2d4f72a7743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:41:13.065561 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:13.065561 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:13.435015 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:13.435015 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8b5d3134-e141-4c3d-9ef7-3774a4e87edf tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:16.910755 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:41:16.943714 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:16.943714 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:17.058149 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:17.058917 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:17.059671 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:17.060059 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:17.078436 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Getting quotas for project de49e15b72cc4f799e77072cb1b062fb. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:41:17.084284 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Getting quotas for user 231cf7e0a0f64d698f54512b54b98572 and project de49e15b72cc4f799e77072cb1b062fb. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:41:17.097710 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] [instance: 08f59c6a-8fb6-4f44-aa1b-6ed0d53e8420] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:41:17.098725 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:17.099216 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:17.172592 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] [instance: 08f59c6a-8fb6-4f44-aa1b-6ed0d53e8420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:41:17.174147 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:17.174566 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:17.469495 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:17.470264 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95315d3c-3821-4614-b2b4-8c33ee612322 tempest-ServerRescueTestJSON-1287291331 tempest-ServerRescueTestJSON-1287291331-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:44.299430 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:41:44.341952 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:44.342401 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:44.506521 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:44.506937 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:44.507699 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:44.508092 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:44.584124 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:41:44.607175 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Getting quotas for user 6d03894fc12d4800ad3b9472eff6dee9 and project 127d4ddf1d3b4d64b9bf6f98001783e0. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:41:44.638739 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: d70b5cbb-8181-4614-b4d7-3c32b79ac9e4] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:41:44.639723 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:44.640115 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:44.751766 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] [instance: d70b5cbb-8181-4614-b4d7-3c32b79ac9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:41:44.751766 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:44.751766 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:41:45.035846 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:41:45.036104 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e66db999-d720-44ca-9221-9daf3eb838f5 tempest-ServersTestJSON-1211041529 tempest-ServersTestJSON-1211041529-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:05.069793 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:42:05.129694 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:05.131610 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:05.403408 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:05.404098 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:05.405064 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:05.405892 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:05.429491 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:42:05.434836 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:42:05.447769 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 21f7ddb6-eee8-4dd1-a95e-2883ff4b9137] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:42:05.449541 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:05.449986 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:05.590922 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 21f7ddb6-eee8-4dd1-a95e-2883ff4b9137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:42:05.592699 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:05.593635 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:05.942910 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:05.943344 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-8a2f48a2-d78b-4a6d-b87f-6209ba84f13b tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:27.474468 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:42:27.507401 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:27.508770 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:27.667389 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:27.668014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:27.669499 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:27.670317 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:27.689494 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:42:27.694865 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:42:27.714840 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 1850a475-f4f8-453c-91ae-7e1f8c4a2a98] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:42:27.715800 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:27.716370 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:27.800191 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 1850a475-f4f8-453c-91ae-7e1f8c4a2a98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:42:27.801133 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:27.801705 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:28.080665 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:28.081540 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bbda5a45-48ee-4aa7-8d81-dc076e9a8f57 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:39.232693 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:42:40.245743 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45426. Apr 18 20:42:42.629508 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:42:42.710050 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:42.710458 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:43.078574 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:43.080742 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:43.088978 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:43.089719 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:43.127683 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Getting quotas for project ef4f149fa74b45f9a27a0187333c739c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:42:43.142727 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Getting quotas for user 659991d940b1491c8231c52b36a8bfab and project ef4f149fa74b45f9a27a0187333c739c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:42:43.165039 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] [instance: ff51e7ad-a7ed-48a3-8ffd-dbf6d5358fbf] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:42:43.168861 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:43.169370 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:43.303977 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] [instance: ff51e7ad-a7ed-48a3-8ffd-dbf6d5358fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:42:43.306333 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:43.306811 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:42:43.779706 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:42:43.779706 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-56c81441-0c2a-43eb-9612-5da3fe4f28fe tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:04.882146 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:43:04.932180 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:04.932180 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:05.097824 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:05.098376 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:05.120145 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:05.120586 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:05.152283 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Getting quotas for project ef4f149fa74b45f9a27a0187333c739c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:43:05.167025 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Getting quotas for user 659991d940b1491c8231c52b36a8bfab and project ef4f149fa74b45f9a27a0187333c739c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:43:05.184350 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] [instance: d5c215fb-48e5-45ca-bb5f-53391f2b06f2] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:43:05.185660 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:05.186061 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:05.284092 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] [instance: d5c215fb-48e5-45ca-bb5f-53391f2b06f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:43:05.288069 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:05.288069 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:05.780361 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:05.781633 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-314b387f-bae8-4603-9003-1950152cebcd tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:07.927240 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:43:07.952675 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:07.953090 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:08.143540 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:08.145736 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:08.148929 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:08.150182 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:08.191953 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:43:08.214044 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:43:08.241609 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 0614dd64-9ec1-4943-99df-0ad9e8dbd355] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:43:08.245150 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:08.245740 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:08.385723 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 0614dd64-9ec1-4943-99df-0ad9e8dbd355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:43:08.386898 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:08.387398 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:08.653346 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:08.653985 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:08.968322 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:08.968950 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-453692f8-7c29-4615-af2e-f6b3ef439a60 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:11.484956 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:43:11.522213 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:11.522213 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:11.723997 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:11.725281 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:11.726235 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:11.726878 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:11.749296 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:43:11.754272 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:43:11.784708 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: e317f5c0-2e5b-472c-a9cb-58cf7882bf5e] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:43:11.787765 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:11.787765 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:11.856885 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: e317f5c0-2e5b-472c-a9cb-58cf7882bf5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:43:11.858390 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:11.858979 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:12.175237 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:12.175768 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-e70f9a8f-d697-4168-a9f1-91d4b9c0b6d8 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:32.425526 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:43:33.294243 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:43:33.341039 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:33.343959 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:33.434060 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46638. Apr 18 20:43:33.538964 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:33.539522 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:33.540457 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:33.540909 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:33.568606 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Getting quotas for project a299819699bb4bc8a887abfa504ad842. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:43:33.574806 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Getting quotas for user d590e910fe8149e0acb0d7086f88ad0a and project a299819699bb4bc8a887abfa504ad842. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:43:33.589626 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] [instance: 8ed6f608-a353-4d16-b424-493305ad16c1] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:43:33.595679 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:33.596096 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:33.671744 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] [instance: 8ed6f608-a353-4d16-b424-493305ad16c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:43:33.676422 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:33.676765 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:33.985151 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:33.985687 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9152e368-7f45-4c2c-84d7-1f2371e85712 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:44.992070 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:43:45.029814 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:45.030328 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:45.189197 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:45.189601 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:45.190325 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:45.190712 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:45.213608 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:43:45.221345 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:43:45.234783 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 56e0bc29-301b-4634-a4dd-3664da631f7d] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:43:45.235875 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:45.236283 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:45.333598 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 56e0bc29-301b-4634-a4dd-3664da631f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:43:45.337442 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:45.337442 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:43:45.596709 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:43:45.596851 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-29d7e00f-14fe-4f08-9ced-c5ea732b3431 tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:06.392401 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:44:06.419431 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:44:06.419914 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:06.585445 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:44:06.586150 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:06.586947 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:44:06.587428 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:06.605953 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Getting quotas for project 575edfe16ed74b1bbd333665f06c3220. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:44:06.610682 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Getting quotas for user 48f4c10cb98742a284422ee34772ddd3 and project 575edfe16ed74b1bbd333665f06c3220. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:44:06.621778 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] [instance: 9895ee9d-3f56-42d5-9e78-c1427f2d191c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:44:06.622703 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:44:06.623120 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:06.715767 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] [instance: 9895ee9d-3f56-42d5-9e78-c1427f2d191c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:44:06.717002 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:44:06.717421 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:07.031037 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:44:07.031478 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-35d1b83a-a09e-484d-92df-bba20d2977dd tempest-AttachVolumeTestJSON-133821620 tempest-AttachVolumeTestJSON-133821620-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:44:35.694553 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:45:13.933874 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c981afae-a96f-4962-a57c-688a5b14df8f tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method unshelve_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:45:13.941168 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c981afae-a96f-4962-a57c-688a5b14df8f tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:13.944063 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c981afae-a96f-4962-a57c-688a5b14df8f tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:15.165869 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c981afae-a96f-4962-a57c-688a5b14df8f tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] [instance: ff51e7ad-a7ed-48a3-8ffd-dbf6d5358fbf] Requesting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) during scheduling {{(pid=94974) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 18 20:45:16.077030 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c981afae-a96f-4962-a57c-688a5b14df8f tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:45:16.091467 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-c981afae-a96f-4962-a57c-688a5b14df8f tempest-ServersNegativeTestJSON-446390475 tempest-ServersNegativeTestJSON-446390475-project] Lazy-loading 'flavor' on Instance uuid ff51e7ad-a7ed-48a3-8ffd-dbf6d5358fbf {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:45:16.793104 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:45:16.837070 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:16.837438 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:17.021202 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:17.021797 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:17.022922 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:17.023463 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:17.043813 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:45:17.049680 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:45:17.061899 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 0e9a4f84-2586-47d9-adeb-b0d07f48cf1c] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:45:17.063332 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:17.063926 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:17.154039 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: 0e9a4f84-2586-47d9-adeb-b0d07f48cf1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:45:17.157052 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:17.157052 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:17.878929 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:17.883466 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c58dd541-acf1-4c7d-bf1d-fac3dd6f41ca tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:29.502219 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-23a1dc38-5e9c-48d7-8f0f-d1d309280cd4 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method unshelve_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:45:29.506469 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23a1dc38-5e9c-48d7-8f0f-d1d309280cd4 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:45:29.506469 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23a1dc38-5e9c-48d7-8f0f-d1d309280cd4 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:45:30.243762 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-23a1dc38-5e9c-48d7-8f0f-d1d309280cd4 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] [instance: 8ed6f608-a353-4d16-b424-493305ad16c1] Requesting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) during scheduling {{(pid=94974) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 18 20:45:30.705635 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-23a1dc38-5e9c-48d7-8f0f-d1d309280cd4 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:45:30.715426 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-23a1dc38-5e9c-48d7-8f0f-d1d309280cd4 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lazy-loading 'flavor' on Instance uuid 8ed6f608-a353-4d16-b424-493305ad16c1 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:45:40.246852 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:45:41.256713 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49642. Apr 18 20:46:07.161837 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:46:15.282123 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:46:15.332076 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:46:15.332076 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:46:15.501478 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:46:15.501753 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:46:15.502483 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:46:15.502872 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:46:15.538840 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:46:15.547819 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Getting quotas for user 1460485dd5544807ba056eb4d104f53c and project e09fc9ff3c0c44e4b69e546cce245cac. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:46:15.571212 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: ce3b7320-94ec-48e1-a43d-7f1541e65fb3] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:46:15.574984 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:46:15.575812 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:46:15.654429 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] [instance: ce3b7320-94ec-48e1-a43d-7f1541e65fb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:46:15.656133 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:46:15.657104 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:46:16.019985 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:46:16.019985 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c272e8d0-c7d9-44c1-99fc-d6669184b0fb tempest-DeleteServersTestJSON-62336297 tempest-DeleteServersTestJSON-62336297-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:46:33.435680 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:46:34.448002 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51236. Apr 18 20:47:02.651615 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:47:02.677153 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:02.684161 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:02.842217 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:02.842623 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:02.843383 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:02.843872 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:02.861918 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Getting quotas for project a299819699bb4bc8a887abfa504ad842. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:47:02.867360 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Getting quotas for user d590e910fe8149e0acb0d7086f88ad0a and project a299819699bb4bc8a887abfa504ad842. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:47:02.881867 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] [instance: 1465c2d0-8e0b-4e79-99d1-b37fe100df76] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:47:02.883735 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:02.884428 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:03.006976 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] [instance: 1465c2d0-8e0b-4e79-99d1-b37fe100df76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:47:03.016251 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:03.017325 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:03.307199 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:03.307639 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-912af667-f878-427e-bb77-f018c1fe1343 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:07.041999 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:47:07.110224 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:07.112393 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:07.385085 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:07.385486 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:07.386413 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:07.386944 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:07.408566 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Getting quotas for project e4c05b3922b147f185918152c5ede883. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:47:07.414556 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Getting quotas for user e6ea0becb8ae4fbc8b9ec620c693d0bd and project e4c05b3922b147f185918152c5ede883. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:47:07.442459 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] [instance: c6543174-d4dc-492a-bb92-d91eefea4c61] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:47:07.443525 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:07.443929 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:07.543949 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] [instance: c6543174-d4dc-492a-bb92-d91eefea4c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:47:07.543949 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:07.543949 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:07.854963 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:07.855393 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ae37a48a-8736-4436-969b-1ddb4f0ee3fb tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.107144 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:47:09.180114 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.182906 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.286689 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:47:09.329737 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.330133 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.421286 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.421694 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.422411 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.422804 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.450626 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Getting quotas for project a3d9f35f89384256b51121a88458d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:47:09.463634 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Getting quotas for user b28a3e481a5e40a79b04b202b0104493 and project a3d9f35f89384256b51121a88458d36d. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:47:09.486407 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.488158 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.489869 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.492063 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.496527 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] [instance: 54c34962-7dc3-4f58-93e7-6dd25f6bd28e] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:47:09.499792 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.500408 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.526618 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Getting quotas for project e4c05b3922b147f185918152c5ede883. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:47:09.531865 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Getting quotas for user e6ea0becb8ae4fbc8b9ec620c693d0bd and project e4c05b3922b147f185918152c5ede883. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:47:09.544857 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] [instance: fe1f673b-8fda-460d-9a09-cb7fd6dd83ab] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:47:09.546047 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.546597 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.573065 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] [instance: 54c34962-7dc3-4f58-93e7-6dd25f6bd28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:47:09.575180 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.575832 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.637999 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] [instance: fe1f673b-8fda-460d-9a09-cb7fd6dd83ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:47:09.640305 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.642143 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:09.930047 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:09.930731 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-5d2a9e15-42fb-46eb-85ed-dbadc8d8d291 tempest-ServersAaction247Test-417788833 tempest-ServersAaction247Test-417788833-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:10.108384 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:10.109186 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-93387c78-5d26-42d0-9360-54abf317e77c tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:11.416027 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:47:11.460794 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:11.461258 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:11.636303 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:11.636303 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:11.636303 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:11.636303 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:11.694593 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Getting quotas for project e4c05b3922b147f185918152c5ede883. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:47:11.711836 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Getting quotas for user e6ea0becb8ae4fbc8b9ec620c693d0bd and project e4c05b3922b147f185918152c5ede883. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:47:11.748864 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] [instance: 353fb612-5a09-451c-a085-91bf68a0031f] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:47:11.762441 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:11.762441 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:11.906768 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] [instance: 353fb612-5a09-451c-a085-91bf68a0031f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:47:11.906768 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:11.906768 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:12.258789 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:47:12.258789 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-71d2d099-f0e1-4cca-aa72-ff8605ca0b74 tempest-ListServerFiltersTestJSON-700431196 tempest-ListServerFiltersTestJSON-700431196-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:47:55.720425 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:48:41.259965 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:48:42.271842 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56342. Apr 18 20:48:52.846964 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Took 1.43 seconds to select destinations for 3 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:48:52.909253 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:52.909870 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:53.292890 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:53.293388 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:53.477642 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:53.480814 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:53.782801 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:53.793318 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:53.813076 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:53.827579 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:53.920079 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Getting quotas for project 4987ee94df434709be56a4003e931d35. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:48:53.951865 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Getting quotas for user bbb1d60304614d55bb8c1a3c57e8a81e and project 4987ee94df434709be56a4003e931d35. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:48:53.990053 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] [instance: 5ded97dd-fb2c-4c0b-bd3a-b0772f797094] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:48:54.006808 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.009099 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:54.121427 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] [instance: 5ded97dd-fb2c-4c0b-bd3a-b0772f797094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:48:54.123402 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.124221 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:54.476457 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.477151 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:54.501951 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] [instance: ebb7d6f4-1d87-4f28-a56e-ba85c8a4624a] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:48:54.503859 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.510936 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:54.626933 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] [instance: ebb7d6f4-1d87-4f28-a56e-ba85c8a4624a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:48:54.628942 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.629344 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:54.912662 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.913348 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:54.932844 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] [instance: b693f0c1-e2a6-4305-b147-1c02b46091a8] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:48:54.937957 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:54.939049 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:55.034811 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] [instance: b693f0c1-e2a6-4305-b147-1c02b46091a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:48:55.038491 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:55.039131 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:48:55.364661 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:48:55.365082 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d229d3c6-7618-417f-912e-5f3582aedd9b tempest-ListServersNegativeTestJSON-75095621 tempest-ListServersNegativeTestJSON-75095621-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:49:27.172708 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:49:34.447650 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:49:35.457760 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57068. Apr 18 20:49:37.363144 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:49:38.129199 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-5189c607-4717-4d6b-9680-ea9b3a5ce080 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method unshelve_instance {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 20:49:38.129765 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-5189c607-4717-4d6b-9680-ea9b3a5ce080 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:49:38.130414 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-5189c607-4717-4d6b-9680-ea9b3a5ce080 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:49:38.379130 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57164. Apr 18 20:49:39.781295 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-5189c607-4717-4d6b-9680-ea9b3a5ce080 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] [instance: 1465c2d0-8e0b-4e79-99d1-b37fe100df76] Requesting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) during scheduling {{(pid=94973) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 18 20:49:40.327045 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-5189c607-4717-4d6b-9680-ea9b3a5ce080 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:49:40.337252 n-d-838332-2 nova-conductor[94973]: DEBUG nova.objects.instance [None req-5189c607-4717-4d6b-9680-ea9b3a5ce080 tempest-AttachVolumeShelveTestJSON-916443641 tempest-AttachVolumeShelveTestJSON-916443641-project] Lazy-loading 'flavor' on Instance uuid 1465c2d0-8e0b-4e79-99d1-b37fe100df76 {{(pid=94973) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 20:49:44.868770 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:49:45.880800 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57346. Apr 18 20:50:21.520822 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Took 1.07 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:50:21.576560 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:21.577195 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:21.914507 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:21.914904 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:21.924438 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:21.924438 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:21.961366 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Getting quotas for project a08002e611df44db8962adaee20e2ead. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:50:21.967191 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Getting quotas for user 7b4b314b37ef433e9f39dc5ddf8e920d and project a08002e611df44db8962adaee20e2ead. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:50:21.999577 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] [instance: 523e68cf-4857-409f-a86a-091aed25afe5] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:50:22.004759 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:22.006637 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:22.150037 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] [instance: 523e68cf-4857-409f-a86a-091aed25afe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:50:22.151762 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:22.152570 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:22.513250 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:22.514268 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-a0c862c8-5bcc-47eb-89c9-e5f2fe1dd5c0 tempest-ServerAddressesTestJSON-428780928 tempest-ServerAddressesTestJSON-428780928-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:24.897272 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:50:26.337341 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:50:40.712863 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:50:40.748409 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:40.748948 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:41.030174 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:41.030793 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:41.032305 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:41.032829 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:41.063005 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Getting quotas for project aa0ec1f8a6634e09b4fbb18322ede344. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:50:41.069258 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Getting quotas for user b816b3b77be84bc4afa0780c08039f1a and project aa0ec1f8a6634e09b4fbb18322ede344. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:50:41.082239 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] [instance: de58ce88-0623-4fe5-9fb2-c1604d2de7be] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:50:41.083614 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:41.084202 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:41.185759 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] [instance: de58ce88-0623-4fe5-9fb2-c1604d2de7be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:50:41.187499 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:41.188137 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:50:41.541584 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:50:41.545150 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8db1e7a7-72d9-4497-8f00-6fede8354fc3 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:08.119602 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Took 1.50 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:51:08.144576 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:51:08.144974 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:08.488507 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:51:08.490984 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:08.492005 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:51:08.499253 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:08.577021 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Getting quotas for project 887248483204482783447c6e98b0a805. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:51:08.582991 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Getting quotas for user 7de002e90a0e447bab8c5557ef29bd6d and project 887248483204482783447c6e98b0a805. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:51:08.605993 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] [instance: 5db8e1de-ecd4-45e0-8987-9a0160ee7a25] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:51:08.607019 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:51:08.615094 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:08.782044 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] [instance: 5db8e1de-ecd4-45e0-8987-9a0160ee7a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:51:08.784989 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:51:08.784989 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:09.127988 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:51:09.128606 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-bb8ae697-102d-4e70-b0a6-48ae03855bbb tempest-ServerAddressesNegativeTestJSON-1325009912 tempest-ServerAddressesNegativeTestJSON-1325009912-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:51:15.729211 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:51:42.272720 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:51:43.283104 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59606. Apr 18 20:52:10.970308 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:52:11.017884 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:11.022852 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:11.254513 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:11.261765 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:11.266950 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:11.268481 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:11.337002 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Getting quotas for project 19dff185104246d9b8c159b45e1020be. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:52:11.357315 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Getting quotas for user be3e5473a4174176a99b1b9e4def9f75 and project 19dff185104246d9b8c159b45e1020be. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:52:11.407483 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] [instance: d69d825f-298f-4a85-8616-049e70d17a0d] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:52:11.408624 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:11.409127 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:11.575195 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] [instance: d69d825f-298f-4a85-8616-049e70d17a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:52:11.577346 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:11.577952 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:11.910772 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:11.911865 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-51ccde49-3895-47c5-a9cb-0ae187ca439e tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:13.476834 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Took 0.61 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:52:13.515512 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:13.515960 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:13.769369 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:13.770336 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:13.772434 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:13.772838 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:13.817721 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Getting quotas for project 19dff185104246d9b8c159b45e1020be. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:52:13.833757 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Getting quotas for user be3e5473a4174176a99b1b9e4def9f75 and project 19dff185104246d9b8c159b45e1020be. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:52:13.872427 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] [instance: dfdf8ce9-844c-4499-b1fd-aabc462cfe21] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:52:13.876943 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:13.877356 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:13.956529 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] [instance: dfdf8ce9-844c-4499-b1fd-aabc462cfe21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:52:13.958523 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:13.958910 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:14.287543 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:14.287979 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e74c5cb5-2d30-4cbf-805c-d92f516ca5e9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:35.461349 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:52:36.467505 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60750. Apr 18 20:52:43.392456 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:52:43.446330 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:43.447956 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:43.671949 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:43.672324 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:43.673115 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:43.673508 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:43.711625 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Getting quotas for project aa0ec1f8a6634e09b4fbb18322ede344. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:52:43.727296 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Getting quotas for user b816b3b77be84bc4afa0780c08039f1a and project aa0ec1f8a6634e09b4fbb18322ede344. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:52:43.762068 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] [instance: 96ca9ac9-596b-4af5-83c9-53ff20523b4a] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:52:43.763624 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:43.764031 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:43.858848 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] [instance: 96ca9ac9-596b-4af5-83c9-53ff20523b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:52:43.860148 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:43.860546 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:44.187586 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:52:44.188246 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-ca5183a7-5193-45cd-a7df-17dd806df5ae tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:52:47.197943 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:54:35.739313 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:54:36.768336 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:54:36.815610 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:36.819548 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:37.016470 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:37.016676 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:37.019154 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:37.019154 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:37.064226 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Getting quotas for project 19dff185104246d9b8c159b45e1020be. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:54:37.080321 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Getting quotas for user be3e5473a4174176a99b1b9e4def9f75 and project 19dff185104246d9b8c159b45e1020be. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:54:37.107581 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] [instance: 81d613ff-56ef-42e4-bf7b-223c2b259ba8] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:54:37.108922 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:37.110908 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:37.243959 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] [instance: 81d613ff-56ef-42e4-bf7b-223c2b259ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:54:37.245768 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:37.246161 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:37.521514 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:37.523161 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1c87e4f7-3140-4378-b30c-a6c90f2c3ea9 tempest-ServerRescueNegativeTestJSON-268528252 tempest-ServerRescueNegativeTestJSON-268528252-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:43.285859 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:54:44.295153 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36380. Apr 18 20:54:45.883641 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:54:46.895457 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 36512. Apr 18 20:54:48.227387 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:54:48.286990 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:48.287409 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:48.576741 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:48.578011 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:48.579113 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:48.579681 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:48.599348 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Getting quotas for project d7f02fbb72e2472bb12c4871c9e0e285. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:54:48.606623 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Getting quotas for user 041f79418993452e937797266a1d99d5 and project d7f02fbb72e2472bb12c4871c9e0e285. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:54:48.616695 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] [instance: dde63505-5cda-4867-98fd-40015998b139] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:54:48.617800 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:48.618142 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:48.682838 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] [instance: dde63505-5cda-4867-98fd-40015998b139] block_device_mapping [BlockDeviceMapping(attachment_id=1f153820-0f45-475d-9c5f-ef16d98c32c3,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='732b9a39-4de4-4f1c-8cad-69b75d2da5df',volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:54:48.684369 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:48.684771 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:48.938584 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:48.939232 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ddff25e1-a140-4a85-a242-d83bc6974955 tempest-TestVolumeBackupRestore-1145088483 tempest-TestVolumeBackupRestore-1145088483-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:49.652789 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Took 2.58 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:54:49.682098 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:49.682815 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:49.827463 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:49.828242 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:49.829117 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:49.829642 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:49.860603 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Getting quotas for project aa0ec1f8a6634e09b4fbb18322ede344. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:54:49.866785 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Getting quotas for user b816b3b77be84bc4afa0780c08039f1a and project aa0ec1f8a6634e09b4fbb18322ede344. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:54:49.881755 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] [instance: 77b1025f-ceb4-40ca-b6ec-37efcca97a6d] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:54:49.883541 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:49.884462 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:50.004038 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] [instance: 77b1025f-ceb4-40ca-b6ec-37efcca97a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:54:50.006065 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:50.006693 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:54:50.270061 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:54:50.270644 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-95a1fd48-9450-4641-919f-5d0cb7c24004 tempest-TestNetworkBasicOps-1694476672 tempest-TestNetworkBasicOps-1694476672-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:20.912358 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:55:20.954692 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:55:20.955113 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:21.257518 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:55:21.258854 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:21.264191 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:55:21.268257 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:21.293812 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Getting quotas for project f978de368ffa4156a4f28b0835b4a088. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:55:21.300902 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Getting quotas for user 64ac3b15e8e441619d422967edc78064 and project f978de368ffa4156a4f28b0835b4a088. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:55:21.322655 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] [instance: 36f5de73-e081-41af-b33b-46392567a69c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:55:21.327095 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:55:21.327460 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:21.432511 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] [instance: 36f5de73-e081-41af-b33b-46392567a69c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:55:21.433965 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:55:21.434789 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:21.879851 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:55:21.879851 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-7806eda4-3457-46e9-8aa2-7f6aa3810628 tempest-VolumesActionsTest-1897994067 tempest-VolumesActionsTest-1897994067-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:55:36.468603 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:55:37.479859 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37882. Apr 18 20:56:07.207954 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:57:06.533973 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Took 1.17 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:57:06.581049 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:57:06.584200 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:57:06.846732 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:57:06.846732 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:57:06.846732 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:57:06.846732 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:57:06.930753 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Getting quotas for project b13db2719dbb47618ebd7b0fded8b5d6. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:57:06.941882 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Getting quotas for user 0ceb7cb4c1004c2e9ea6438293f2d70c and project b13db2719dbb47618ebd7b0fded8b5d6. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:57:06.969008 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] [instance: a9d5b333-7ebd-4813-9f26-20820f01745b] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:57:06.973257 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:57:06.973905 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:57:07.052185 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] [instance: a9d5b333-7ebd-4813-9f26-20820f01745b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:57:07.054769 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:57:07.054769 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:57:07.448757 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:57:07.450013 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7389d0c2-3a48-4f8d-966d-fd9970a95f01 tempest-VolumesNegativeTest-1404549339 tempest-VolumesNegativeTest-1404549339-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:57:38.378968 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:57:39.392544 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40814. Apr 18 20:57:44.296846 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:57:45.310219 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40970. Apr 18 20:57:46.895828 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 20:57:47.904057 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41060. Apr 18 20:57:55.747641 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:58:28.808050 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:58:28.843529 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:28.843958 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:29.062043 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:29.062430 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:29.067927 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:29.068510 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:29.135620 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Getting quotas for project d736381127134565835c1d6753f72f83. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:58:29.147639 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Getting quotas for user aa17d0ed54a54a55ba95dd1d983304bc and project d736381127134565835c1d6753f72f83. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:58:29.162698 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] [instance: 49918717-d676-4783-978a-7bc306499e1b] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:58:29.163673 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:29.164059 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:29.228841 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] [instance: 49918717-d676-4783-978a-7bc306499e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:58:29.230065 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:29.230453 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:29.520873 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:29.521340 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7d115267-5d27-4829-a4ff-b833d941aa02 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:37.477500 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 20:58:38.488274 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42306. Apr 18 20:58:53.906512 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:58:53.948754 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:53.949155 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:54.136515 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:54.137192 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:54.138117 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:54.138754 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:54.155653 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Getting quotas for project d736381127134565835c1d6753f72f83. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:58:54.167662 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Getting quotas for user aa17d0ed54a54a55ba95dd1d983304bc and project d736381127134565835c1d6753f72f83. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:58:54.179475 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] [instance: 340f2868-201b-4046-bbfa-d62e055a7e40] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:58:54.180450 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:54.180846 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:54.319367 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] [instance: 340f2868-201b-4046-bbfa-d62e055a7e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:58:54.320641 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:54.321231 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:58:54.542278 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:58:54.542809 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-34556517-2372-4d49-a230-7b517ff30701 tempest-VolumesActionsTest-1406484135 tempest-VolumesActionsTest-1406484135-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:59:27.217880 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 20:59:37.376528 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 20:59:37.426542 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:59:37.427107 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:59:37.709923 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:59:37.710404 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:59:37.711985 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:59:37.715641 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:59:37.751106 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Getting quotas for project c3984fcac14b42ae83113fda7fd8e17b. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 20:59:37.756786 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Getting quotas for user 17a4dd8ffec941f3a10c28be4ca11fb8 and project c3984fcac14b42ae83113fda7fd8e17b. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 20:59:37.772545 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] [instance: 905248b0-a890-433e-8e10-824af6520e57] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 20:59:37.774208 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:59:37.774929 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:59:37.844923 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] [instance: 905248b0-a890-433e-8e10-824af6520e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 20:59:37.847694 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:59:37.848117 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 20:59:38.177127 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 20:59:38.177556 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1cd1826e-4417-487c-82c4-2f133f696e35 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:23.598254 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:00:23.639663 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:00:23.640462 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:23.863927 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:00:23.865124 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:23.866275 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:00:23.866659 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:23.892083 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Getting quotas for project 5a6573cf856945e1a83544af4f0f835c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:00:23.897227 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Getting quotas for user dfdad9b150024bf0bb5adab929ac33dc and project 5a6573cf856945e1a83544af4f0f835c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:00:23.913605 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] [instance: 3434e4b4-1246-4f5d-b574-e20f8213ee34] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:00:23.914951 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:00:23.915560 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:23.982045 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] [instance: 3434e4b4-1246-4f5d-b574-e20f8213ee34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:00:23.984094 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:00:23.984659 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:24.253757 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:00:24.253757 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-1293f4be-f6b0-458d-9b7c-de7a1af0883d tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:00:45.308741 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:00:46.319531 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46362. Apr 18 21:01:05.469360 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:01:05.493218 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:01:05.493618 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:01:05.608866 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:01:05.609258 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:01:05.609969 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:01:05.610469 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:01:05.625419 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Getting quotas for project c3984fcac14b42ae83113fda7fd8e17b. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:01:05.629834 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Getting quotas for user 17a4dd8ffec941f3a10c28be4ca11fb8 and project c3984fcac14b42ae83113fda7fd8e17b. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:01:05.640607 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] [instance: 47a09262-0582-4006-a72d-a32221831dcb] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:01:05.641505 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:01:05.641893 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:01:05.718527 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] [instance: 47a09262-0582-4006-a72d-a32221831dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:01:05.720144 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:01:05.720797 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:01:05.958194 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:01:05.958604 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-99dedec5-1184-4ceb-a656-fa7ae1058664 tempest-VolumesSnapshotTestJSON-246189052 tempest-VolumesSnapshotTestJSON-246189052-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:01:15.756683 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:01:38.488467 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:01:39.497473 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47500. Apr 18 21:02:12.368224 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:02:12.394177 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:12.394672 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:12.540979 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:12.541664 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:12.542602 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:12.543206 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:12.580330 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Getting quotas for project 5a6573cf856945e1a83544af4f0f835c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:02:12.584281 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Getting quotas for user dfdad9b150024bf0bb5adab929ac33dc and project 5a6573cf856945e1a83544af4f0f835c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:02:12.626876 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] [instance: b2c1dac0-8140-47a9-a160-ffffe3017780] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:02:12.630749 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:12.631180 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:12.728079 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] [instance: b2c1dac0-8140-47a9-a160-ffffe3017780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:02:12.729424 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:12.729999 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:13.094808 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:13.095243 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c4c0195a-2fc0-409c-8fd7-556c61fb847f tempest-TestSecurityGroupsBasicOps-474490728 tempest-TestSecurityGroupsBasicOps-474490728-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:27.379820 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:02:27.403400 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:27.403803 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:27.699145 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:27.699468 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:27.700756 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:27.701175 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:27.716021 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Getting quotas for project 15d5459ea1634e3984cf894079a7e875. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:02:27.720801 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Getting quotas for user f520859541844ea7b0d0046dedfb86ee and project 15d5459ea1634e3984cf894079a7e875. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:02:27.731981 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] [instance: e2d9d212-1dc5-4c2a-af48-07d2ca82eba3] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:02:27.732900 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:27.733462 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:27.814117 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] [instance: e2d9d212-1dc5-4c2a-af48-07d2ca82eba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:02:27.815394 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:27.815782 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:28.105663 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:02:28.106760 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-9d9fdaa0-0463-4f96-a150-923459b8017f tempest-TestServerAdvancedOps-449108600 tempest-TestServerAdvancedOps-449108600-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:02:47.231769 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:03:30.555889 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:03:30.591966 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:30.592461 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:30.848170 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:30.848578 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:30.849302 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:30.849692 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:30.865809 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Getting quotas for project 4f0221bb47cc44018ca47493b76b1492. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:03:30.874744 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Getting quotas for user c0271f5bc3ce4e13b68afa359040ca61 and project 4f0221bb47cc44018ca47493b76b1492. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:03:30.880913 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] [instance: 6b138d79-afef-47dc-bbdc-2fc20c873cef] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:03:30.881460 n-d-838332-2 nova-conductor[94974]: DEBUG nova.scheduler.utils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-838332-2']) and/or node ([]) {{(pid=94974) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Apr 18 21:03:30.882216 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:30.882614 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:30.967520 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] [instance: 6b138d79-afef-47dc-bbdc-2fc20c873cef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:03:30.969917 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:30.970502 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:31.310696 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:31.311589 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-b5193e82-f468-4a17-a04e-a1be592e6358 tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:43.892313 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:03:43.914165 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:43.920243 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:44.133978 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:44.134487 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:44.135628 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:44.136016 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:44.154501 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Getting quotas for project a69fcd8efd0f42aa849732416c9392d0. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:03:44.159634 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Getting quotas for user 81439ed800934f8fbcbb3af80a7c4f79 and project a69fcd8efd0f42aa849732416c9392d0. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:03:44.173024 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] [instance: f7a06bd0-9960-48e5-a375-24cb0a55656a] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:03:44.173949 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:44.174540 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:44.230547 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] [instance: f7a06bd0-9960-48e5-a375-24cb0a55656a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:03:44.232506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:44.232897 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:44.596459 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:44.596947 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-d3149068-feb4-4d2b-a83a-5128be5c4507 tempest-TestServerBasicOps-50866957 tempest-TestServerBasicOps-50866957-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:46.206694 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:03:46.229538 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:46.229939 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:46.319666 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:03:46.398383 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:46.398801 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:46.399826 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:46.401176 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:46.417329 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Getting quotas for project 4f0221bb47cc44018ca47493b76b1492. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:03:46.422079 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Getting quotas for user c0271f5bc3ce4e13b68afa359040ca61 and project 4f0221bb47cc44018ca47493b76b1492. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:03:46.434307 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] [instance: dedc9056-b3ca-40ec-814c-32771dae2788] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:03:46.435586 n-d-838332-2 nova-conductor[94974]: DEBUG nova.scheduler.utils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-838332-2']) and/or node ([]) {{(pid=94974) populate_retry /opt/stack/nova/nova/scheduler/utils.py:951}} Apr 18 21:03:46.436373 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:46.436778 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:46.487835 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] [instance: dedc9056-b3ca-40ec-814c-32771dae2788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:03:46.489286 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:46.489691 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:46.715845 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:03:46.716246 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f9187849-1827-4a84-aa08-6a7638b8364d tempest-TestServerMultinode-1839754071 tempest-TestServerMultinode-1839754071-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:03:47.327288 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50184. Apr 18 21:04:35.764635 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:04:39.499012 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:04:40.506381 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51142. Apr 18 21:05:47.910136 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:05:48.919573 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51654. Apr 18 21:06:07.241758 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:06:25.035110 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:06:25.059534 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:06:25.059534 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:06:25.248919 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:06:25.249404 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:06:25.250177 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:06:25.250634 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:06:25.266213 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:06:25.270840 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for user cee19d1484b04ee5a942335f5f321a41 and project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:06:25.281413 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: 4fe706e5-8839-48a1-b59d-5fcab7e1e146] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:06:25.282332 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:06:25.282735 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:06:25.342021 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: 4fe706e5-8839-48a1-b59d-5fcab7e1e146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:06:25.343296 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:06:25.344122 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:06:25.589208 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:06:25.589933 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-f632bb00-46d1-46a6-9857-2dfa1145dbf9 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:06:39.393754 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:06:40.412377 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51904. Apr 18 21:06:47.328739 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:06:48.336273 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51920. Apr 18 21:07:04.921695 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:07:06.365151 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:07:11.657103 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-244e3f16-aee8-43da-b5cc-a1e55b9f5ad4 tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:07:11.657572 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-244e3f16-aee8-43da-b5cc-a1e55b9f5ad4 tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:07:11.657968 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-244e3f16-aee8-43da-b5cc-a1e55b9f5ad4 tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:07:12.055762 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-244e3f16-aee8-43da-b5cc-a1e55b9f5ad4 tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] [instance: 4fe706e5-8839-48a1-b59d-5fcab7e1e146] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:07:12.650176 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-244e3f16-aee8-43da-b5cc-a1e55b9f5ad4 tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Created allocations for migration 68c48430-4d4a-44bd-9b77-fe379ea3c790 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:07:13.125301 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-244e3f16-aee8-43da-b5cc-a1e55b9f5ad4 tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] [instance: 4fe706e5-8839-48a1-b59d-5fcab7e1e146] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:07:40.508649 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:07:41.520748 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52068. Apr 18 21:07:55.772714 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:08:48.920824 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:08:49.928695 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52200. Apr 18 21:08:57.065581 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:08:57.100523 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:08:57.101404 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:08:57.193080 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:08:57.193750 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:08:57.194466 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:08:57.194846 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:08:57.211290 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:08:57.216920 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for user cee19d1484b04ee5a942335f5f321a41 and project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:08:57.227871 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: 9e1438cc-a1bc-442d-b8cc-26cb4e6c3ba0] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:08:57.228799 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:08:57.229189 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:08:57.309216 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: 9e1438cc-a1bc-442d-b8cc-26cb4e6c3ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:08:57.310626 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:08:57.311156 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:08:57.631811 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:08:57.632214 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-986c6f93-3d22-4561-9a52-41f0bfb21b0f tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:09:27.250445 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:09:37.326981 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:09:38.341377 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52402. Apr 18 21:09:43.297951 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:09:44.306375 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52408. Apr 18 21:09:45.789066 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-72052b9f-aae2-43f4-8c27-713507cabcdb tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:09:45.789655 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-72052b9f-aae2-43f4-8c27-713507cabcdb tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:09:45.789655 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-72052b9f-aae2-43f4-8c27-713507cabcdb tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:09:46.277552 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-72052b9f-aae2-43f4-8c27-713507cabcdb tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] [instance: 9e1438cc-a1bc-442d-b8cc-26cb4e6c3ba0] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94974) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:09:46.816319 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-72052b9f-aae2-43f4-8c27-713507cabcdb tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Created allocations for migration a1f9afbe-433c-45e5-a0ac-e4bdaf2d3770 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94974) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:09:47.144046 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-72052b9f-aae2-43f4-8c27-713507cabcdb tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] [instance: 9e1438cc-a1bc-442d-b8cc-26cb4e6c3ba0] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [] {{(pid=94974) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:09:48.337483 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:09:49.345687 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52464. Apr 18 21:10:23.315358 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:10:25.837380 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:10:41.522297 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:10:42.530605 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52542. Apr 18 21:11:15.298708 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:11:15.321809 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:11:15.322192 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:11:15.526609 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:11:15.527107 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:11:15.527895 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:11:15.528343 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:11:15.546854 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:11:15.551859 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for user cee19d1484b04ee5a942335f5f321a41 and project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:11:15.564277 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: 7c470cbb-2da9-41dd-a9e4-68475802c1bd] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:11:15.565608 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:11:15.566274 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:11:15.654498 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: 7c470cbb-2da9-41dd-a9e4-68475802c1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:11:15.655824 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:11:15.656394 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:11:15.780855 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:11:15.920831 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:11:15.921327 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-c08aff20-a5da-4dec-814e-d660531fcd1d tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:11:49.929683 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:11:50.938115 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52738. Apr 18 21:12:04.052091 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:12:04.052779 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:04.052949 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:04.633955 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.migrate [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Created allocations for migration 44024e16-a322-4ced-a995-6df68f55bda7 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94974) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:12:04.819203 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.live_migrate [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] [instance: 7c470cbb-2da9-41dd-a9e4-68475802c1bd] Requesting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while live migrating {{(pid=94974) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} Apr 18 21:12:05.175206 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lazy-loading 'resources' on Instance uuid 7c470cbb-2da9-41dd-a9e4-68475802c1bd {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 21:12:05.179461 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] Lazy-loading 'pci_requests' on Instance uuid 7c470cbb-2da9-41dd-a9e4-68475802c1bd {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 21:12:05.937234 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.tasks.live_migrate [None req-fcbab945-c54c-44b1-aa2c-800c95624cfd tempest-TestNetworkAdvancedServerOps-1788144112 tempest-TestNetworkAdvancedServerOps-1788144112-project-admin] [instance: 7c470cbb-2da9-41dd-a9e4-68475802c1bd] Start binding ports on destination host: n-h2-838332-2 {{(pid=94974) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Apr 18 21:12:47.223541 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:12:47.247135 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:47.247539 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:47.261103 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:12:47.372422 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:47.372731 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:47.373438 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:47.373817 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:47.389466 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:12:47.394247 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Getting quotas for user cee19d1484b04ee5a942335f5f321a41 and project 8039b8646fa94caf99ac43ac633e1860. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:12:47.405180 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: bc1f74ba-3d63-4600-9f09-b48c06d7a092] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:12:47.406107 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:47.406497 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:47.492751 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: bc1f74ba-3d63-4600-9f09-b48c06d7a092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:12:47.494097 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:47.494492 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:47.772968 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:12:47.774236 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-175c1da6-80f0-4904-b49d-c105e4173d26 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:12:49.346264 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:12:50.356311 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52980. Apr 18 21:13:35.153251 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c96fc5d5-a513-43b9-8790-bd4dfa819a18 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method rebuild_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:13:35.153741 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c96fc5d5-a513-43b9-8790-bd4dfa819a18 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:13:35.154099 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c96fc5d5-a513-43b9-8790-bd4dfa819a18 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:13:35.261672 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c96fc5d5-a513-43b9-8790-bd4dfa819a18 tempest-TestNetworkAdvancedServerOps-1350682288 tempest-TestNetworkAdvancedServerOps-1350682288-project] [instance: bc1f74ba-3d63-4600-9f09-b48c06d7a092] No migration record for the rebuild/evacuate request. {{(pid=94974) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Apr 18 21:14:42.532828 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:14:43.542331 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53160. Apr 18 21:14:50.938878 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:14:51.946459 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53216. Apr 18 21:15:08.185148 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:15:08.207124 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:15:08.207530 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:15:08.420756 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:15:08.421160 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:15:08.421884 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:15:08.422273 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:15:08.437587 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:15:08.442071 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:15:08.452910 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: f8f3d41a-2bbb-45f4-9cb0-fa396e5dbf55] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:15:08.453786 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:15:08.454256 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:15:08.542294 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: f8f3d41a-2bbb-45f4-9cb0-fa396e5dbf55] block_device_mapping [BlockDeviceMapping(attachment_id=cae8d3b1-2019-4c03-9b00-89987d4e5cd2,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bc5ebb2-029e-4ac4-98e3-465b7b4ef1d5',volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:15:08.543930 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:15:08.544425 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:15:08.843206 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:15:08.843604 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-3db09873-3d13-4554-9032-fb954a4c5279 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:15:24.933897 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:15:40.408966 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:15:41.422946 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53448. Apr 18 21:15:50.355649 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:15:51.364249 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53494. Apr 18 21:16:02.773900 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:16:02.796182 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:16:02.796583 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:16:02.928168 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:16:02.928554 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:16:02.929267 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:16:02.929647 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:16:02.944136 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:16:02.948525 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:16:02.958726 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 6fe147e0-eda0-4075-bda4-1191fc085d05] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:16:02.959622 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:16:02.960012 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:16:03.020155 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 6fe147e0-eda0-4075-bda4-1191fc085d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3f28a50e-2bbe-4b41-ad64-c223dd96ce20',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:16:03.021306 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:16:03.021756 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:16:03.305296 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:16:03.305705 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-788f23ac-7309-4c09-bdbb-6368ee3674cf tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:16:07.275212 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:16:15.791015 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:17:20.178075 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:17:20.199979 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:20.200381 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:20.337067 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:20.337460 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:20.338169 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:20.338551 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:20.353643 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:17:20.358126 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:17:20.369225 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 5da93953-e46b-4bbc-8def-07a920b6752a] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:17:20.370099 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:20.370488 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:20.430485 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 5da93953-e46b-4bbc-8def-07a920b6752a] block_device_mapping [BlockDeviceMapping(attachment_id=ab602783-8988-4b72-af92-d28cd56aa2d4,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21c88b67-ae64-444a-87e9-854f48f57156',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:17:20.431749 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:20.432144 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:20.693008 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:20.693346 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4e7ebd4a-9554-4289-9386-a2af0043b6e8 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:42.435039 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:17:42.457483 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:42.457483 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:42.593496 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:42.593884 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:42.594658 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:42.594960 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:42.610883 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:17:42.615647 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:17:42.625673 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: fa25e900-9eb7-4888-9422-b3c0893944fb] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:17:42.626544 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:42.626930 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:42.692625 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: fa25e900-9eb7-4888-9422-b3c0893944fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e37f0277-7eea-41fa-b547-6bea39226c24',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:17:42.693828 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:42.694212 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:42.846621 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:17:42.847014 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-b45418be-8d2a-4424-a088-16eb7b9c152e tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:17:43.542729 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:17:44.550714 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 53998. Apr 18 21:18:51.365688 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:18:52.373231 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54220. Apr 18 21:19:16.838939 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:19:16.861777 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:19:16.862170 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:19:16.980775 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:19:16.981168 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:19:16.981881 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:19:16.982261 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:19:17.000115 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:19:17.005201 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:19:17.015349 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 715b79ee-7550-4ccd-8869-9b7b0657f710] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:19:17.016223 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:19:17.016608 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:19:17.068182 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 715b79ee-7550-4ccd-8869-9b7b0657f710] block_device_mapping [BlockDeviceMapping(attachment_id=95d980c4-49b4-4f06-bd2b-54e75e1e0888,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5163dce2-a102-42a7-a64c-88378aa55a61',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:19:17.069381 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:19:17.069771 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:19:17.291481 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:19:17.291883 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-23d7a496-e645-4f5c-b86e-704d7aa3d8d3 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:19:27.287642 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:19:35.799675 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:19:44.316037 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:19:45.321463 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54488. Apr 18 21:20:23.330441 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 21:20:38.343741 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:20:39.358156 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54518. Apr 18 21:20:44.551026 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:20:45.560435 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54522. Apr 18 21:21:41.420708 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:21:42.435460 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54544. Apr 18 21:21:51.951834 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:21:52.374413 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:21:52.960880 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54546. Apr 18 21:21:53.381870 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54548. Apr 18 21:22:04.944255 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:22:45.323612 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:22:46.333802 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54596. Apr 18 21:22:47.295700 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:22:49.644564 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:22:49.666099 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:22:49.666500 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:22:49.768502 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:22:49.768900 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:22:49.769626 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:22:49.770015 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:22:49.788547 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:22:49.793120 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:22:49.803674 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: b6177869-fec2-4646-aee6-10989e27af9b] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:22:49.805073 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:22:49.805463 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:22:49.900897 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: b6177869-fec2-4646-aee6-10989e27af9b] block_device_mapping [BlockDeviceMapping(attachment_id=b1823b0b-c097-4977-8fb3-8a14240407d7,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5163dce2-a102-42a7-a64c-88378aa55a61',volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:22:49.902076 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:22:49.902472 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:22:50.130496 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:22:50.130920 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:22:50.139918 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [82cf728a-b146-4a68-8b88-e2ec03aebdae] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 18 21:22:51.146056 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [None req-92ce76c4-586a-41e0-9c80-2d30423dbbd6 tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [82cf728a-b146-4a68-8b88-e2ec03aebdae] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54646. Apr 18 21:22:55.807861 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:23:45.561367 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:23:46.570146 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54716. Apr 18 21:24:42.430356 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:24:43.443790 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54734. Apr 18 21:24:52.964681 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:24:53.382538 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:24:53.972178 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54740. Apr 18 21:24:54.390369 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54742. Apr 18 21:25:23.339939 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:25:24.952391 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:25:26.386837 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:25:39.354815 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:25:40.369669 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54802. Apr 18 21:25:46.333754 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:25:47.341905 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54816. Apr 18 21:25:56.086805 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:25:56.108727 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:25:56.109122 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:25:56.270055 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:25:56.270455 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:25:56.271212 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:25:56.271598 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:25:56.287493 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:25:56.292063 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Getting quotas for user 6fa0bd9832a04a2ba2eba841e136ef2b and project 783c668428614bbfa2e83138cf3b3f2c. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:25:56.302937 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 10c3bfe1-be2d-45b2-b892-a581e277cf8a] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:25:56.303882 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:25:56.304278 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:25:56.385819 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] [instance: 10c3bfe1-be2d-45b2-b892-a581e277cf8a] block_device_mapping [BlockDeviceMapping(attachment_id=420addd8-26e9-4b73-8ed4-48a3e11ccf99,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae6b4054-df29-4b67-b98e-953e0af8773b',volume_size=1,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:25:56.387080 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:25:56.387491 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:25:56.620319 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:25:56.620728 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-63497131-c631-402c-a233-ee99ec27c67c tempest-TestVolumeBootPattern-1460207401 tempest-TestVolumeBootPattern-1460207401-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:26:07.307314 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:26:15.816653 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:26:46.577368 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:26:47.583643 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54942. Apr 18 21:27:54.392245 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:27:55.401203 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54962. Apr 18 21:28:40.364622 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:28:41.378685 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54976. Apr 18 21:28:43.346806 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:28:43.440634 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:28:44.453690 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54986. Apr 18 21:28:44.961191 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:28:45.859611 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:28:46.394655 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:28:47.343710 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:28:48.353022 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55000. Apr 18 21:28:53.975540 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:28:54.983434 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55002. Apr 18 21:29:27.315431 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:29:35.825287 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:29:47.585029 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:29:48.550081 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:29:48.574118 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:29:48.574513 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:29:48.591353 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55220. Apr 18 21:29:48.811337 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:29:48.811649 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:29:48.812359 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:29:48.812738 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:29:48.827918 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Getting quotas for project 687f91aa7e4d4ac5bcaee2b41ee14f0a. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:29:48.832904 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Getting quotas for user ff65c9379be347ea82e2495d97f16c9a and project 687f91aa7e4d4ac5bcaee2b41ee14f0a. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:29:48.843237 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] [instance: 7b950703-4f9b-47f1-af19-26f0cf8763de] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:29:48.844160 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:29:48.844636 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:29:48.943730 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] [instance: 7b950703-4f9b-47f1-af19-26f0cf8763de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:29:48.944911 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:29:48.945303 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:29:49.215553 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:29:49.215947 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-74d35a7b-a29f-4e0b-bf3a-f587712b834f tempest-ServersAdminNegativeTestJSON-368641049 tempest-ServersAdminNegativeTestJSON-368641049-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:14.351700 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:30:14.373125 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:14.373518 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:14.532686 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:14.533082 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:14.533826 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:14.534291 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:14.549032 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Getting quotas for project 1c1255e749804d6d89820303f75966ed. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:30:14.554072 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Getting quotas for user 84ec15b986854111a557f6a0a54a569e and project 1c1255e749804d6d89820303f75966ed. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:30:14.564954 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] [instance: 1dac5bbb-a928-40b9-9e80-3f59e0046587] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:30:14.565893 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:14.566290 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:14.620499 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] [instance: 1dac5bbb-a928-40b9-9e80-3f59e0046587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:30:14.621775 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:14.622154 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:14.843596 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:14.844030 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-dcbce3cc-927a-499d-86f7-1b380adfa259 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:26.558240 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-57338262-66ad-4bdf-b92b-a382c7d05887 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:30:26.560072 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-57338262-66ad-4bdf-b92b-a382c7d05887 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:30:26.560072 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-57338262-66ad-4bdf-b92b-a382c7d05887 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:30:26.949944 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-57338262-66ad-4bdf-b92b-a382c7d05887 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] [instance: 1dac5bbb-a928-40b9-9e80-3f59e0046587] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:30:27.471269 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-57338262-66ad-4bdf-b92b-a382c7d05887 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] Created allocations for migration a03e51d9-909b-4e70-9064-d5bad9907b49 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:30:27.801279 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-57338262-66ad-4bdf-b92b-a382c7d05887 tempest-DeleteServersTestJSON-1360767985 tempest-DeleteServersTestJSON-1360767985-project] [instance: 1dac5bbb-a928-40b9-9e80-3f59e0046587] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:30:55.401549 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:30:56.408931 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55498. Apr 18 21:31:06.108098 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:31:06.129664 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:06.130067 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:06.406817 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:06.407163 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:06.407880 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:06.408262 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:06.423232 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Getting quotas for project 273ec61030054140908163ee5903699f. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:31:06.427701 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Getting quotas for user 0ab9aaf3cbaf431c836ed58a0791d10a and project 273ec61030054140908163ee5903699f. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:31:06.438194 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: 73cfe480-0bc5-4c71-a316-34a2001ccaa8] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:31:06.439081 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:06.439484 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:06.510575 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: 73cfe480-0bc5-4c71-a316-34a2001ccaa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:31:06.512307 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:06.512725 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:06.748545 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:06.748947 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-bb7108ec-5ec9-4cdf-83b0-ec9309ac62fd tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:22.024305 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-5ccb78b1-28bf-4c71-8767-bc3d6c6e4def tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:31:22.024789 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-5ccb78b1-28bf-4c71-8767-bc3d6c6e4def tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:22.025168 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-5ccb78b1-28bf-4c71-8767-bc3d6c6e4def tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:22.378188 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-5ccb78b1-28bf-4c71-8767-bc3d6c6e4def tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: 73cfe480-0bc5-4c71-a316-34a2001ccaa8] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:31:22.938808 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-5ccb78b1-28bf-4c71-8767-bc3d6c6e4def tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Created allocations for migration 3e41a9d8-034f-4a0c-aa39-b1b2a201a18c on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:31:23.430599 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-5ccb78b1-28bf-4c71-8767-bc3d6c6e4def tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: 73cfe480-0bc5-4c71-a316-34a2001ccaa8] Calling prep_resize with selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"65455175-3040-428f-952a-6449c7e9beb4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["65455175-3040-428f-952a-6449c7e9beb4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=65455175-3040-428f-952a-6449c7e9beb4,limits=SchedulerLimits,nodename='n-h2-838332-2',service_host='n-h2-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:31:53.618552 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:31:53.640006 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:53.640418 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:53.783221 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:53.783714 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:53.784493 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:53.784876 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:53.800203 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Getting quotas for project 273ec61030054140908163ee5903699f. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:31:53.805264 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Getting quotas for user 0ab9aaf3cbaf431c836ed58a0791d10a and project 273ec61030054140908163ee5903699f. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:31:53.815570 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: dccb162e-b39a-41b4-8b2c-b53816838de1] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:31:53.816473 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:53.816863 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:53.904813 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: dccb162e-b39a-41b4-8b2c-b53816838de1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:31:53.906227 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:53.906624 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:31:54.176646 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:31:54.177049 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-de828bf2-5c6c-4878-95cd-36f5daa7f130 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:32:06.439428 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-ffdf1335-5d14-418f-afb3-d24cd70923e4 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:32:06.440475 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ffdf1335-5d14-418f-afb3-d24cd70923e4 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:32:06.440870 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-ffdf1335-5d14-418f-afb3-d24cd70923e4 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:32:06.715601 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-ffdf1335-5d14-418f-afb3-d24cd70923e4 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: dccb162e-b39a-41b4-8b2c-b53816838de1] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:32:07.215057 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-ffdf1335-5d14-418f-afb3-d24cd70923e4 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] Created allocations for migration 05099465-3a5f-43f7-b929-71395a3c0eb1 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:32:07.550002 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-ffdf1335-5d14-418f-afb3-d24cd70923e4 tempest-ServerDiskConfigTestJSON-747591228 tempest-ServerDiskConfigTestJSON-747591228-project] [instance: dccb162e-b39a-41b4-8b2c-b53816838de1] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:32:47.324742 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:32:48.591730 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:32:49.600870 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55890. Apr 18 21:32:55.845355 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:33:07.337209 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:33:07.358620 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:07.359088 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:07.580533 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:07.580848 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:07.581558 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:07.581939 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:07.597272 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:33:07.602321 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for user a68460527c454ee0b47604437b19b89b and project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:33:07.612441 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 8990ac66-035e-4dca-9973-cc7cc904dc60] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:33:07.613347 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:07.613744 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:07.760747 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 8990ac66-035e-4dca-9973-cc7cc904dc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:33:07.762124 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:07.762526 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:08.021268 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:08.021673 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-f3e4ee19-53eb-4f9d-9907-7f794b9a41b6 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:25.960094 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-0b27b077-221e-4317-af97-dc56ec882b00 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:33:25.960561 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0b27b077-221e-4317-af97-dc56ec882b00 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:33:25.960968 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-0b27b077-221e-4317-af97-dc56ec882b00 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:33:26.239420 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-0b27b077-221e-4317-af97-dc56ec882b00 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 8990ac66-035e-4dca-9973-cc7cc904dc60] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:33:26.819337 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-0b27b077-221e-4317-af97-dc56ec882b00 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Created allocations for migration ed05a24a-72d7-4791-83fb-aaacc748f618 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:33:27.188696 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-0b27b077-221e-4317-af97-dc56ec882b00 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 8990ac66-035e-4dca-9973-cc7cc904dc60] Calling prep_resize with selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"65455175-3040-428f-952a-6449c7e9beb4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["65455175-3040-428f-952a-6449c7e9beb4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=65455175-3040-428f-952a-6449c7e9beb4,limits=SchedulerLimits,nodename='n-h2-838332-2',service_host='n-h2-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:33:56.410574 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:33:57.417597 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56134. Apr 18 21:34:07.079418 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:34:07.102028 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:07.106149 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:07.198733 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:07.199165 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:07.200068 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:07.200322 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:07.215596 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:34:07.220121 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for user a68460527c454ee0b47604437b19b89b and project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:34:07.230399 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: aabd98e8-3481-4ef4-831c-e4bbfd6c27b0] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:34:07.231316 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:07.231706 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:07.301977 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: aabd98e8-3481-4ef4-831c-e4bbfd6c27b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:34:07.303310 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:07.303712 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:07.569151 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:07.569548 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-0a183fb6-578a-4e1d-8212-55f57d6971bc tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:47.030102 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-11fabcf1-7379-4b63-b0d0-ed91d9ca9117 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:34:47.030649 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-11fabcf1-7379-4b63-b0d0-ed91d9ca9117 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:34:47.030972 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-11fabcf1-7379-4b63-b0d0-ed91d9ca9117 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:34:47.325832 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-11fabcf1-7379-4b63-b0d0-ed91d9ca9117 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: aabd98e8-3481-4ef4-831c-e4bbfd6c27b0] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:34:47.887936 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-11fabcf1-7379-4b63-b0d0-ed91d9ca9117 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Created allocations for migration 565b30ff-a661-4ce2-8cf6-dc8dba7c3497 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:34:48.307976 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-11fabcf1-7379-4b63-b0d0-ed91d9ca9117 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: aabd98e8-3481-4ef4-831c-e4bbfd6c27b0] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:35:12.540582 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:35:12.563195 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:12.563599 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:12.732342 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:12.732739 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:12.733452 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:12.733841 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:12.751517 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:35:12.756247 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for user a68460527c454ee0b47604437b19b89b and project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:35:12.766290 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: bcfbda13-8a63-4a74-a45b-5501b27aa104] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:35:12.767191 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:12.767582 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:12.855054 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: bcfbda13-8a63-4a74-a45b-5501b27aa104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:35:12.856271 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:12.856662 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:13.198968 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:13.199339 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-8ed91840-c5b2-4b00-9f40-66f0532a9b51 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:28.227369 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1066c779-d059-46ba-b4b9-551855da0fce tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:35:28.227848 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1066c779-d059-46ba-b4b9-551855da0fce tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:35:28.228265 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1066c779-d059-46ba-b4b9-551855da0fce tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:35:28.803061 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-1066c779-d059-46ba-b4b9-551855da0fce tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: bcfbda13-8a63-4a74-a45b-5501b27aa104] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:35:29.361578 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-1066c779-d059-46ba-b4b9-551855da0fce tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Created allocations for migration ffdfb6e6-d61e-4682-b17a-fe29c5914c11 on 65455175-3040-428f-952a-6449c7e9beb4 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:35:29.717310 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-1066c779-d059-46ba-b4b9-551855da0fce tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: bcfbda13-8a63-4a74-a45b-5501b27aa104] Calling prep_resize with selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"65455175-3040-428f-952a-6449c7e9beb4": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["65455175-3040-428f-952a-6449c7e9beb4"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=65455175-3040-428f-952a-6449c7e9beb4,limits=SchedulerLimits,nodename='n-h2-838332-2',service_host='n-h2-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:35:49.600790 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:35:50.608804 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56492. Apr 18 21:36:07.333580 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:36:15.852888 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:36:23.212634 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:36:23.235259 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:23.235658 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:23.354299 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:23.355239 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:23.355954 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:23.356336 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:23.371027 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:36:23.375580 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Getting quotas for user a68460527c454ee0b47604437b19b89b and project c77c8752361f46968c3a90be44b88398. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:36:23.386055 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 1666671a-ff61-4337-ba59-c8ba2161b07c] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:36:23.386924 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:23.387357 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:23.452650 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 1666671a-ff61-4337-ba59-c8ba2161b07c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:36:23.453816 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:23.454208 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:23.745130 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:23.745536 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4115b612-bf77-41cd-88ee-258930e97831 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:51.568820 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-6921be0e-edce-40bc-a0f9-de2061598771 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:36:51.569310 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-6921be0e-edce-40bc-a0f9-de2061598771 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:36:51.569678 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-6921be0e-edce-40bc-a0f9-de2061598771 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:36:51.861631 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-6921be0e-edce-40bc-a0f9-de2061598771 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 1666671a-ff61-4337-ba59-c8ba2161b07c] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:36:52.381827 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-6921be0e-edce-40bc-a0f9-de2061598771 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] Created allocations for migration 98719c12-7b6a-442d-ac6d-6f56de0ceb72 on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:36:52.812856 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-6921be0e-edce-40bc-a0f9-de2061598771 tempest-ServerActionsTestJSON-1307218822 tempest-ServerActionsTestJSON-1307218822-project] [instance: 1666671a-ff61-4337-ba59-c8ba2161b07c] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:36:57.418532 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:36:58.425727 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56730. Apr 18 21:37:58.046376 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:37:58.067394 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:37:58.067797 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:37:58.274014 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:37:58.274406 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:37:58.275136 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:37:58.275521 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:37:58.290568 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Getting quotas for project f9def8b6e87d48fb9fc12372e5732150. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:37:58.295034 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Getting quotas for user eced0a30bc0b48a3862e86a1b14cb95e and project f9def8b6e87d48fb9fc12372e5732150. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:37:58.305191 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] [instance: c7de5d43-a56d-4319-ada6-7110977019df] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:37:58.306074 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:37:58.306462 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:37:58.366608 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] [instance: c7de5d43-a56d-4319-ada6-7110977019df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:37:58.368006 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:37:58.368451 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:37:58.578781 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:37:58.579145 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-03d25518-9865-4a92-818e-4d31382a6f4b tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:12.673612 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:38:12.695660 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:38:12.696059 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:12.861533 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:38:12.861849 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:12.862550 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:38:12.862932 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:12.878098 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Getting quotas for project f9def8b6e87d48fb9fc12372e5732150. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:38:12.883155 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Getting quotas for user eced0a30bc0b48a3862e86a1b14cb95e and project f9def8b6e87d48fb9fc12372e5732150. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:38:12.893242 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] [instance: 74ac56f4-4371-4d2f-a17c-6103ad4eb069] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:38:12.894115 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:38:12.894504 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:12.966463 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] [instance: 74ac56f4-4371-4d2f-a17c-6103ad4eb069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:38:12.967767 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:38:12.968158 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:13.200747 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:38:13.201070 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e94aae6b-b41a-4297-aaa0-1bf683fce13e tempest-ServersNegativeTestJSON-474735884 tempest-ServersNegativeTestJSON-474735884-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:38:50.610628 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:38:51.620552 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57154. Apr 18 21:39:27.342066 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:39:32.108126 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:39:32.131893 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:39:32.132920 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:39:32.340812 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:39:32.342355 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:39:32.344030 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:39:32.344633 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:39:32.367810 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Getting quotas for project 6fbd3c7f43224862b2a1433ca51e6791. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:39:32.373309 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Getting quotas for user eaa3c2b926504dda9ca823d39a0d2876 and project 6fbd3c7f43224862b2a1433ca51e6791. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:39:32.386906 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] [instance: 737e0836-de64-4b57-a17e-ac207705dd86] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:39:32.387341 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:39:32.387803 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:39:32.462626 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] [instance: 737e0836-de64-4b57-a17e-ac207705dd86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:39:32.463975 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:39:32.464381 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:39:32.930717 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:39:32.931145 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-28a2f5db-53fe-4ce3-b44d-465c420da2a6 tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:39:35.861351 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:39:58.426685 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:39:59.435946 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57520. Apr 18 21:40:12.077261 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:40:12.100061 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:40:12.100458 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:40:12.208069 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:40:12.208473 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:40:12.209180 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:40:12.209562 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:40:12.224912 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Getting quotas for project 6fbd3c7f43224862b2a1433ca51e6791. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:40:12.229364 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Getting quotas for user eaa3c2b926504dda9ca823d39a0d2876 and project 6fbd3c7f43224862b2a1433ca51e6791. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:40:12.240503 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] [instance: 2efef10e-1a38-4669-9476-95c5e81c3b54] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:40:12.241393 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:40:12.241781 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:40:12.307330 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] [instance: 2efef10e-1a38-4669-9476-95c5e81c3b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:40:12.308585 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:40:12.308984 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:40:12.616167 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:40:12.616567 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-95ede805-8cdd-4e0f-9b53-f1916bc56b1b tempest-TestEncryptedCinderVolumes-663618184 tempest-TestEncryptedCinderVolumes-663618184-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:28.179423 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:41:28.201273 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:41:28.201665 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:28.405516 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:41:28.405909 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:28.406623 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:41:28.407007 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:28.422495 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Getting quotas for project f15f6d54170d43d5afb800285424b740. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:41:28.427585 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Getting quotas for user 5e7ecc7c773f4b4d906a38415cbdd374 and project f15f6d54170d43d5afb800285424b740. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:41:28.437789 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] [instance: 2dddb132-70b7-4481-8283-8e9ae520874d] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:41:28.438663 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:41:28.439054 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:28.499869 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] [instance: 2dddb132-70b7-4481-8283-8e9ae520874d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6c05886-b4ab-43e7-a5cf-4214ba8a118e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:41:28.501028 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:41:28.501422 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:28.715841 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:41:28.715841 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-9a2cae67-a04b-4573-b897-c2f2130342e6 tempest-TestMinimumBasicScenario-1136200670 tempest-TestMinimumBasicScenario-1136200670-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:41:51.620896 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:41:52.629043 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57998. Apr 18 21:42:41.384713 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:42:42.397248 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58110. Apr 18 21:42:47.351314 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:42:48.364655 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:42:49.372223 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58114. Apr 18 21:42:55.870227 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:42:59.434742 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:43:00.442922 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58120. Apr 18 21:43:44.462780 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:43:44.981146 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:43:45.479531 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58382. Apr 18 21:43:49.493519 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:43:49.517208 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:43:49.520685 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:43:49.709997 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:43:49.710401 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:43:49.711180 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:43:49.711571 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:43:49.734132 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:43:49.739482 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for user 4ef6d5c3bf6e43febb51306e2c70fb11 and project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:43:49.753234 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: a4dd15e8-8775-4f56-bc8a-6c44ad0959f1] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:43:49.754166 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:43:49.754582 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:43:49.824118 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: a4dd15e8-8775-4f56-bc8a-6c44ad0959f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:43:49.828833 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:43:49.828833 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:43:50.092904 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:43:50.093344 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-88cd5156-c660-4c49-9add-04e46a5fbdde tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:43:54.996574 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:43:56.003679 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58424. Apr 18 21:44:52.629436 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:44:53.638944 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58564. Apr 18 21:45:04.333770 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:45:04.361663 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:45:04.361663 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:45:04.467390 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:45:04.467808 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:45:04.468544 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:45:04.468911 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:45:04.485028 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:45:04.490584 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for user 4ef6d5c3bf6e43febb51306e2c70fb11 and project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:45:04.501226 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 062f31fc-2b7c-4a5b-a4c1-95ca976582b8] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:45:04.502150 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:45:04.502540 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:45:04.611853 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 062f31fc-2b7c-4a5b-a4c1-95ca976582b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:45:04.613106 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:45:04.613506 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:45:04.795026 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:45:04.795747 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-4f37e30f-f262-42be-8daf-f544ed39f35f tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:46:00.444377 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:46:01.451651 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58716. Apr 18 21:46:07.360468 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:46:15.878868 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:46:42.395374 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:46:43.411223 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58810. Apr 18 21:46:49.374795 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:46:50.382780 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58844. Apr 18 21:46:52.757856 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:46:52.782037 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:46:52.782439 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:46:52.894165 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:46:52.896509 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:46:52.896509 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:46:52.896509 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:46:52.912126 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:46:52.916831 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for user 4ef6d5c3bf6e43febb51306e2c70fb11 and project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:46:52.928022 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 42460af4-578d-40a1-b130-0d0e7d10f0de] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:46:52.928976 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:46:52.929528 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:46:52.964201 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 42460af4-578d-40a1-b130-0d0e7d10f0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:46:52.965488 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:46:52.966017 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:46:53.211326 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:46:53.211843 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-70f842f1-3a36-456c-9980-00372f92f704 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:47:03.369610 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:47:05.882267 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:47:34.070690 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-491d91b5-9f34-4380-a92f-f057646005da tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method migrate_server {{(pid=94973) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:47:34.071280 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-491d91b5-9f34-4380-a92f-f057646005da tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:47:34.071584 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-491d91b5-9f34-4380-a92f-f057646005da tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:47:34.370889 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-491d91b5-9f34-4380-a92f-f057646005da tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 42460af4-578d-40a1-b130-0d0e7d10f0de] Restricting to cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) while migrating {{(pid=94973) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Apr 18 21:47:34.872668 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-491d91b5-9f34-4380-a92f-f057646005da tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Created allocations for migration 1db97967-d8ff-4667-87bc-955f3015dcac on b023a38b-7560-4ce7-aafe-990353c156b6 {{(pid=94973) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Apr 18 21:47:35.241198 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.tasks.migrate [None req-491d91b5-9f34-4380-a92f-f057646005da tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 42460af4-578d-40a1-b130-0d0e7d10f0de] Calling prep_resize with selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [Selection(allocation_request='{"allocations": {"b023a38b-7560-4ce7-aafe-990353c156b6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["b023a38b-7560-4ce7-aafe-990353c156b6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=2dfc0e2a-76ec-46bd-8fe6-8870e7fce206,compute_node_uuid=b023a38b-7560-4ce7-aafe-990353c156b6,limits=SchedulerLimits,nodename='n-h1-838332-2',service_host='n-h1-838332-2')] {{(pid=94973) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:315}} Apr 18 21:47:53.639869 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:47:54.648155 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59002. Apr 18 21:48:56.007039 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:48:57.015687 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59056. Apr 18 21:49:01.452866 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:49:02.473059 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59076. Apr 18 21:49:16.888217 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:49:16.911696 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:49:16.912008 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:49:17.035597 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:49:17.035995 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:49:17.036717 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:49:17.037103 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:49:17.052279 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:49:17.056798 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for user 4ef6d5c3bf6e43febb51306e2c70fb11 and project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:49:17.068608 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 7a82b0d1-814e-4ba0-b769-7dc4675002f0] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:49:17.068608 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:49:17.068608 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:49:17.157721 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 7a82b0d1-814e-4ba0-b769-7dc4675002f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:49:17.159424 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:49:17.159873 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:49:17.439512 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:49:17.439843 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-af50f3b2-8ca5-4b0b-aae9-d125efa613e5 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:49:27.369862 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:49:35.887804 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:49:43.404911 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:49:44.417729 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59224. Apr 18 21:49:50.384461 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:49:51.391963 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59226. Apr 18 21:50:23.376979 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:50:25.891120 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:50:54.648441 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:50:55.655856 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59350. Apr 18 21:51:08.882539 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:51:08.906913 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:51:08.907349 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:51:09.030612 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:51:09.031200 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:51:09.031999 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:51:09.032453 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:51:09.048999 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:51:09.053732 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Getting quotas for user 4ef6d5c3bf6e43febb51306e2c70fb11 and project 584daf98e8034b558b8de9603f97f831. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:51:09.065138 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 83a095bc-9179-49ee-8768-0f6858f567d9] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:51:09.066078 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:51:09.066609 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:51:09.149334 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] [instance: 83a095bc-9179-49ee-8768-0f6858f567d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:51:09.150607 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:51:09.150999 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:51:09.441992 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:51:09.442329 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-38294aaa-568f-4a7c-8e21-67cd401fc2d1 tempest-TestNetworkAdvancedServerOps-1938091642 tempest-TestNetworkAdvancedServerOps-1938091642-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:02.474257 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:52:03.481073 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59526. Apr 18 21:52:35.915911 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:52:35.937559 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:52:35.937953 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:36.163273 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:52:36.163670 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:36.164387 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:52:36.164766 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:36.183422 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Getting quotas for project 8226314bdba344e6bea7cc8e1bc1db62. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:52:36.188512 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Getting quotas for user 3be7de0a3b0946cbb72883d13996c2e7 and project 8226314bdba344e6bea7cc8e1bc1db62. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:52:36.198656 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] [instance: 62988213-6514-47bb-b37e-ba97afcdf1f4] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:52:36.199576 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:52:36.199968 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:36.262370 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] [instance: 62988213-6514-47bb-b37e-ba97afcdf1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:52:36.263679 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:52:36.264068 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:36.542326 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:52:36.542801 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-7b2c8d48-f4d8-468c-b9dc-115feef90c45 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:52:47.378270 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:52:55.895870 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:53:45.481993 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:53:46.494449 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59778. Apr 18 21:53:55.657661 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:53:56.666844 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59780. Apr 18 21:53:57.019259 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:53:58.026179 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59782. Apr 18 21:54:44.417735 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:54:45.431412 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59790. Apr 18 21:54:51.394610 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:54:52.402425 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59820. Apr 18 21:55:03.482515 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:55:04.489886 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59878. Apr 18 21:55:14.581076 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c0796cb1-f884-4f8c-9c6f-1ee681a96d78 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method unshelve_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 21:55:14.581615 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c0796cb1-f884-4f8c-9c6f-1ee681a96d78 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:55:14.581934 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-c0796cb1-f884-4f8c-9c6f-1ee681a96d78 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:55:15.253588 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c0796cb1-f884-4f8c-9c6f-1ee681a96d78 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] [instance: 62988213-6514-47bb-b37e-ba97afcdf1f4] Requesting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) during scheduling {{(pid=94974) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 18 21:55:15.666120 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-c0796cb1-f884-4f8c-9c6f-1ee681a96d78 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:55:15.674198 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-c0796cb1-f884-4f8c-9c6f-1ee681a96d78 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lazy-loading 'flavor' on Instance uuid 62988213-6514-47bb-b37e-ba97afcdf1f4 {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 21:55:23.386207 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 21:55:25.901002 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:56:07.385825 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:56:15.903623 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:56:56.668276 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:56:57.676125 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60204. Apr 18 21:57:16.893080 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 21:57:16.915509 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:57:16.915912 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:57:17.037344 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:57:17.037735 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:57:17.038449 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:57:17.038832 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:57:17.053633 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Getting quotas for project 8226314bdba344e6bea7cc8e1bc1db62. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 21:57:17.058143 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Getting quotas for user 3be7de0a3b0946cbb72883d13996c2e7 and project 8226314bdba344e6bea7cc8e1bc1db62. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 21:57:17.068496 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] [instance: 7c0e8e74-e6cf-4c9e-805f-e717a9fb3e9a] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 21:57:17.069379 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:57:17.069762 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:57:17.122859 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] [instance: 7c0e8e74-e6cf-4c9e-805f-e717a9fb3e9a] block_device_mapping [BlockDeviceMapping(attachment_id=a2651ae9-4e95-4948-9b47-c00b1b668e32,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a1f2c22-ed14-493c-8dbd-02f4434146b0',volume_size=1,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 21:57:17.124100 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:57:17.124524 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:57:17.350929 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 21:57:17.351382 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-1b5bd3a6-a090-4457-bdb5-98d6119126cd tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 21:57:46.493140 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:57:47.505394 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60344. Apr 18 21:57:58.028939 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:57:59.036402 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60346. Apr 18 21:58:04.492631 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:58:05.501345 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60350. Apr 18 21:59:27.393639 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:59:35.911633 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:59:45.428726 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:59:46.440737 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60380. Apr 18 21:59:52.406192 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 21:59:53.413445 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60384. Apr 18 21:59:57.677011 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 21:59:58.684125 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60386. Apr 18 22:00:23.396170 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:00:25.005100 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:00:25.909894 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:00:26.428803 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:00:31.608648 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-36aa010a-523c-45a0-a63a-e90d3d56e380 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Targeting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) for conductor method unshelve_instance {{(pid=94974) wrapper /opt/stack/nova/nova/conductor/manager.py:91}} Apr 18 22:00:31.609202 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-36aa010a-523c-45a0-a63a-e90d3d56e380 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:00:31.609554 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-36aa010a-523c-45a0-a63a-e90d3d56e380 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:00:31.880319 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-36aa010a-523c-45a0-a63a-e90d3d56e380 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] [instance: 7c0e8e74-e6cf-4c9e-805f-e717a9fb3e9a] Requesting cell 2dfc0e2a-76ec-46bd-8fe6-8870e7fce206(cell1) during scheduling {{(pid=94974) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Apr 18 22:00:32.329710 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-36aa010a-523c-45a0-a63a-e90d3d56e380 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 22:00:32.338075 n-d-838332-2 nova-conductor[94974]: DEBUG nova.objects.instance [None req-36aa010a-523c-45a0-a63a-e90d3d56e380 tempest-TestShelveInstance-44367042 tempest-TestShelveInstance-44367042-project] Lazy-loading 'flavor' on Instance uuid 7c0e8e74-e6cf-4c9e-805f-e717a9fb3e9a {{(pid=94974) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 18 22:01:05.501432 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:01:06.515861 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60506. Apr 18 22:02:46.437860 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:02:47.401349 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:02:47.450916 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60574. Apr 18 22:02:47.503902 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:02:48.531944 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60580. Apr 18 22:02:53.415780 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:02:54.423172 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60598. Apr 18 22:02:55.919707 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:02:58.685414 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:02:59.039699 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:02:59.693243 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60658. Apr 18 22:03:00.046952 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60660. Apr 18 22:03:19.704775 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=94973) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 22:03:19.726695 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:03:19.727094 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:03:19.885896 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:03:19.886293 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:03:19.887017 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:03:19.887430 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:03:19.902630 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Getting quotas for project c6a7996534d64c32bac33574f1874bb4. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 22:03:19.907676 n-d-838332-2 nova-conductor[94973]: DEBUG nova.quota [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Getting quotas for user fb6da415596e486797d0ce22fc6b4f1c and project c6a7996534d64c32bac33574f1874bb4. Resources: {'instances', 'ram', 'cores'} {{(pid=94973) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 22:03:19.917985 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] [instance: bee303e0-86f5-4c0b-bd55-3e063f67d7d1] Selected host: n-h1-838332-2; Selected node: n-h1-838332-2; Alternates: [('n-h2-838332-2', 'n-h2-838332-2')] {{(pid=94973) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 22:03:19.919449 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:03:19.919841 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:03:20.002895 n-d-838332-2 nova-conductor[94973]: DEBUG nova.conductor.manager [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] [instance: bee303e0-86f5-4c0b-bd55-3e063f67d7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e54044e3-f867-43fe-8f93-7f060d092eb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94973) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 22:03:20.004123 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:03:20.004506 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:03:20.288151 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:03:20.288551 n-d-838332-2 nova-conductor[94973]: DEBUG oslo_concurrency.lockutils [None req-e56dca5d-3e33-4420-9a95-dc957e0ee46c tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94973) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:03:45.013532 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:03:46.436714 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:04:06.511553 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:04:07.518887 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60834. Apr 18 22:05:23.406550 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:05:25.919719 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 22:05:47.091672 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=94974) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Apr 18 22:05:47.115308 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:05:47.115709 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:05:47.385618 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:05:47.386012 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:05:47.386768 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:05:47.387191 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:05:47.402848 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Getting quotas for project c6a7996534d64c32bac33574f1874bb4. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 18 22:05:47.409000 n-d-838332-2 nova-conductor[94974]: DEBUG nova.quota [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Getting quotas for user fb6da415596e486797d0ce22fc6b4f1c and project c6a7996534d64c32bac33574f1874bb4. Resources: {'instances', 'ram', 'cores'} {{(pid=94974) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 18 22:05:47.419923 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] [instance: 99a4312d-89d9-44b8-9621-beadc5fbe493] Selected host: n-h2-838332-2; Selected node: n-h2-838332-2; Alternates: [('n-h1-838332-2', 'n-h1-838332-2')] {{(pid=94974) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Apr 18 22:05:47.420897 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:05:47.421284 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:05:47.447593 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:05:47.525175 n-d-838332-2 nova-conductor[94974]: DEBUG nova.conductor.manager [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] [instance: 99a4312d-89d9-44b8-9621-beadc5fbe493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='126a4edb-b161-40c0-ab62-47a0006eaae5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94974) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Apr 18 22:05:47.526404 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:05:47.526800 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:05:47.789576 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 18 22:05:47.789975 n-d-838332-2 nova-conductor[94974]: DEBUG oslo_concurrency.lockutils [None req-10d3b6d3-7a54-4a8a-bc73-05a3f19022a1 tempest-TestSnapshotPattern-2091548469 tempest-TestSnapshotPattern-2091548469-project] Lock "2dfc0e2a-76ec-46bd-8fe6-8870e7fce206" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94974) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 18 22:05:48.460459 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32806. Apr 18 22:05:54.425096 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:05:55.437253 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32848. Apr 18 22:05:59.693726 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:06:00.701189 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32864. Apr 18 22:06:07.409771 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:06:15.933233 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:07:07.519625 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:07:08.528585 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32916. Apr 18 22:07:48.518707 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:07:49.534146 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32932. Apr 18 22:08:00.049798 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:08:01.058313 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32938. Apr 18 22:08:43.413948 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:08:45.024329 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:08:45.927325 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:08:46.446421 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 22:08:48.456622 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:08:49.469467 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33180. Apr 18 22:08:55.435853 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:08:56.443493 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33246. Apr 18 22:09:00.703456 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:09:01.713488 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33266. Apr 18 22:09:27.417798 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:09:35.941040 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:10:08.529725 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:10:09.538899 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33324. Apr 18 22:10:49.527702 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:10:50.541073 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33334. Apr 18 22:11:01.058834 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:11:02.066997 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33336. Apr 18 22:11:49.465665 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:11:50.480421 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33342. Apr 18 22:11:56.443643 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:11:57.450139 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33344. Apr 18 22:12:01.713368 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:12:02.721508 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33346. Apr 18 22:12:03.422497 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:12:05.032755 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:12:05.935138 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:12:06.454798 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:12:47.426013 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:12:55.948636 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:13:09.539277 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:13:10.547711 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33376. Apr 18 22:13:50.536692 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:13:51.551299 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33384. Apr 18 22:14:02.067759 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:14:03.075180 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33390. Apr 18 22:14:50.474356 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:14:51.487260 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33396. Apr 18 22:14:57.451490 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:14:58.458911 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33398. Apr 18 22:15:02.722439 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:15:03.730572 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [52286b4e-061c-452f-9325-13dccdbab0f6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33400. Apr 18 22:15:23.429527 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:15:25.041466 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:15:25.943320 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:15:26.463646 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:16:07.433541 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:16:10.547440 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:16:11.555455 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [508e4df9-2096-4ac1-9466-5e95d56f257f] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33422. Apr 18 22:16:15.956777 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 22:16:51.546848 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:16:52.560912 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [e6d6bca8-3bd1-4574-b9ce-0cff110863eb] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33426. Apr 18 22:17:03.076566 n-d-838332-2 nova-conductor[94974]: ERROR oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 18 22:17:04.084544 n-d-838332-2 nova-conductor[94974]: INFO oslo.messaging._drivers.impl_rabbit [-] [548d5100-bbfa-41f9-92c3-ca0c05e00c24] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33430. Apr 18 22:17:51.482713 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:17:52.496637 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d22edb4-d9dd-4ff7-a32e-44fee9f02337] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33444. Apr 18 22:17:58.460723 n-d-838332-2 nova-conductor[94973]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 18 22:17:59.468067 n-d-838332-2 nova-conductor[94973]: INFO oslo.messaging._drivers.impl_rabbit [-] [d14ee32c-df29-47e6-90d1-0ac086131d29] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33452.