-- Logs begin at Thu 2021-12-16 17:58:32 UTC, end at Thu 2021-12-16 20:49:30 UTC. -- Dec 16 18:35:15.781372 n-d-821350-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Dec 16 18:35:18.974592 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_db.sqlalchemy.engines [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:35:19.193534 n-d-821350-1 nova-conductor[88936]: DEBUG nova.context [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) {{(pid=88936) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 18:35:19.198178 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_concurrency.lockutils [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:35:19.199806 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_concurrency.lockutils [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:35:19.200757 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_concurrency.lockutils [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:35:19.202633 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_concurrency.lockutils [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:35:19.231842 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_db.sqlalchemy.engines [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:35:19.239668 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_db.sqlalchemy.engines [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:35:19.248103 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_concurrency.lockutils [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Acquired lock "singleton_lock" {{(pid=88936) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 18:35:19.248800 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_concurrency.lockutils [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Releasing lock "singleton_lock" {{(pid=88936) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 18:35:19.249617 n-d-821350-1 nova-conductor[88936]: INFO oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Starting 2 workers Dec 16 18:35:19.254433 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Started child 89821 {{(pid=88936) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Dec 16 18:35:19.259630 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Started child 89822 {{(pid=88936) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Dec 16 18:35:19.260947 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Full set of CONF: {{(pid=88936) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Dec 16 18:35:19.261426 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ******************************************************************************** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 18:35:19.261856 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] Configuration options gathered from: {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 18:35:19.262287 n-d-821350-1 nova-conductor[89821]: INFO nova.service [-] Starting conductor node (version 22.3.1) Dec 16 18:35:19.262812 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 18:35:19.263198 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] config files: ['/etc/nova/nova.conf'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 18:35:19.263642 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ================================================================================ {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 18:35:19.264468 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] allow_resize_to_same_host = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.265050 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] arq_binding_timeout = 300 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.265575 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] bandwidth_poll_interval = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.266477 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] bindir = /usr/local/bin {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.267125 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] block_device_allocate_retries = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.275104 n-d-821350-1 nova-conductor[89822]: INFO nova.service [-] Starting conductor node (version 22.3.1) Dec 16 18:35:19.276410 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] block_device_allocate_retries_interval = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.277216 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cert = self.pem {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.277845 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute_driver = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.278591 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute_monitors = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.279262 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] config_dir = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.279940 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] config_drive_format = iso9660 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.280478 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.281139 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] config_source = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.281757 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] console_host = n-d-821350-1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.282479 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] control_exchange = nova {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.283106 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cpu_allocation_ratio = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.283986 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] daemon = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.284646 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] debug = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.285361 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] default_access_ip_network_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.286007 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] default_availability_zone = nova {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.286661 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] default_ephemeral_format = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.290386 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.291086 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] default_schedule_zone = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.291696 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] disk_allocation_ratio = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.292345 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] enable_new_services = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.293010 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] enabled_apis = ['osapi_compute'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.297738 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] enabled_ssl_apis = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.297916 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc45f49-4522-4296-a97b-93e27de6ad7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:35:19.298636 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] flat_injected = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.299262 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] force_config_drive = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.299894 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] force_raw_images = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.300533 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] graceful_shutdown_timeout = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.301205 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] heal_instance_info_cache_interval = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.301831 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] host = n-d-821350-1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.302505 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.303108 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] initial_disk_allocation_ratio = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.307596 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] initial_ram_allocation_ratio = 1.5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.308414 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.309033 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_build_timeout = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.309627 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_delete_interval = 300 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.310269 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_format = [instance: %(uuid)s] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.312793 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_name_template = instance-%08x {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.313452 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_usage_audit = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.314098 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_usage_audit_period = month {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.316117 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.316770 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] instances_path = /opt/stack/data/nova/instances {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.317383 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] internal_service_availability_zone = internal {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.318132 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] key = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.319652 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] live_migration_retry_count = 30 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.321362 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_config_append = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.322941 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.323829 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_dir = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.324742 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.325419 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_options = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.326060 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_rotate_interval = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.328250 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_rotate_interval_type = days {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.328920 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] log_rotation_type = none {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.329986 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.331131 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.332162 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.333344 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.333880 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.337247 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] long_rpc_timeout = 1800 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.337896 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] max_concurrent_builds = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.339550 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] max_concurrent_live_migrations = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.340170 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] max_concurrent_snapshots = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.341576 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] max_local_block_devices = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.342245 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] max_logfile_count = 30 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.343562 n-d-821350-1 nova-conductor[89821]: DEBUG nova.service [None req-6bc45f49-4522-4296-a97b-93e27de6ad7c None None] Creating RPC server for service conductor {{(pid=89821) start /opt/stack/nova/nova/service.py:182}} Dec 16 18:35:19.344170 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] max_logfile_size_mb = 200 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.344769 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] maximum_instance_delete_attempts = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.345703 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metadata_listen = 0.0.0.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.347004 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metadata_listen_port = 8775 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.347971 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metadata_workers = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.348760 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] migrate_max_retries = -1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.349436 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] mkisofs_cmd = genisoimage {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.350637 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_db.sqlalchemy.engines [None req-05c7bf6b-3f78-4da8-ac14-46ecc8aed17f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:35:19.351652 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] my_block_storage_ip = 10.222.0.31 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.352499 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] my_ip = 10.222.0.31 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.354129 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] network_allocate_retries = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.359307 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.360071 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] osapi_compute_listen = 0.0.0.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.360677 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] osapi_compute_listen_port = 8774 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.361307 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] osapi_compute_unique_server_name_scope = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.361943 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] osapi_compute_workers = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.362585 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] password_length = 12 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.363222 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] periodic_enable = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.363833 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] periodic_fuzzy_delay = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.364443 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] pointer_model = usbtablet {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.366906 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] preallocate_images = none {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.367656 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] publish_errors = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.368216 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] pybasedir = /opt/stack/nova {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.369254 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ram_allocation_ratio = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.373620 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rate_limit_burst = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.374411 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rate_limit_except_level = CRITICAL {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.375092 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rate_limit_interval = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.375729 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] reboot_timeout = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.376376 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] reclaim_instance_interval = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.376979 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] record = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.377588 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] report_interval = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.378225 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rescue_timeout = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.379447 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] reserved_host_cpus = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.382079 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] reserved_host_disk_mb = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.383321 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] reserved_host_memory_mb = 512 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.383976 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] reserved_huge_pages = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.385786 n-d-821350-1 nova-conductor[89822]: DEBUG nova.service [None req-05c7bf6b-3f78-4da8-ac14-46ecc8aed17f None None] Creating RPC server for service conductor {{(pid=89822) start /opt/stack/nova/nova/service.py:182}} Dec 16 18:35:19.386471 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] resize_confirm_window = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.387098 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] resize_fs_using_block_device = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.387707 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] resume_guests_state_on_host_boot = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.388326 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.389623 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rpc_response_timeout = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.399890 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] run_external_periodic_tasks = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.400605 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] running_deleted_instance_action = reap {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.401242 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.401841 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] running_deleted_instance_timeout = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.402478 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler_instance_sync_interval = 120 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.403087 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_down_time = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.406048 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] servicegroup_driver = db {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.407704 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] shelved_offload_time = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.408319 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] shelved_poll_interval = 3600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.408948 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] shutdown_timeout = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.412240 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] source_is_ipv6 = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.412924 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ssl_only = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.413562 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] state_path = /opt/stack/data/nova {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.414237 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] sync_power_state_interval = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.414851 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] sync_power_state_pool_size = 1000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.415458 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] syslog_log_facility = LOG_USER {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.416059 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] tempdir = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.419331 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] timeout_nbd = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.423612 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] transport_url = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.425309 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] update_resources_interval = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.432022 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_cow_images = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.433167 n-d-821350-1 nova-conductor[89821]: DEBUG nova.service [None req-6bc45f49-4522-4296-a97b-93e27de6ad7c None None] Join ServiceGroup membership for this service conductor {{(pid=89821) start /opt/stack/nova/nova/service.py:199}} Dec 16 18:35:19.433411 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_eventlog = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.433612 n-d-821350-1 nova-conductor[89821]: DEBUG nova.servicegroup.drivers.db [None req-6bc45f49-4522-4296-a97b-93e27de6ad7c None None] DB_Driver: join new ServiceGroup member n-d-821350-1 to the conductor group, service = {{(pid=89821) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Dec 16 18:35:19.435536 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_journal = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.436146 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_json = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.436755 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_rootwrap_daemon = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.437365 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_stderr = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.442479 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] use_syslog = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.443158 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vcpu_pin_set = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.443847 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vif_plugging_is_fatal = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.444479 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vif_plugging_timeout = 300 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.445154 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] virt_mkfs = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.446294 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] volume_usage_poll_interval = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.447419 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] watch_log_file = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.447419 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] web = /usr/share/spice-html5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:35:19.448086 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_concurrency.disable_process_locking = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.448616 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.449179 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.auth_strategy = keystone {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.449833 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.compute_link_prefix = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.450566 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.451183 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.dhcp_domain = novalocal {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.451789 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.enable_instance_password = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.452535 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.glance_link_prefix = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.453140 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.453781 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.454420 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.instance_list_per_project_cells = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.455010 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.list_records_by_skipping_down_cells = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.455612 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.local_metadata_per_cell = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.456273 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.max_limit = 1000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.456880 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.metadata_cache_expiration = 15 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.457488 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.neutron_default_tenant_id = default {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.458081 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.use_forwarded_for = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.458720 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.use_neutron_default_nets = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.459314 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.459926 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.460529 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.461667 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.464589 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_dynamic_targets = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.467698 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_jsonfile_path = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.468414 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.469433 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.backend = dogpile.cache.memcached {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.471095 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.backend_argument = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.472837 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.config_prefix = cache.oslo {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.477237 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.debug_cache_backend = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.478544 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.enabled = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.479045 n-d-821350-1 nova-conductor[89822]: DEBUG nova.service [None req-05c7bf6b-3f78-4da8-ac14-46ecc8aed17f None None] Join ServiceGroup membership for this service conductor {{(pid=89822) start /opt/stack/nova/nova/service.py:199}} Dec 16 18:35:19.479438 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.expiration_time = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.479542 n-d-821350-1 nova-conductor[89822]: DEBUG nova.servicegroup.drivers.db [None req-05c7bf6b-3f78-4da8-ac14-46ecc8aed17f None None] DB_Driver: join new ServiceGroup member n-d-821350-1 to the conductor group, service = {{(pid=89822) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Dec 16 18:35:19.480166 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.memcache_dead_retry = 300 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.481943 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.482500 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.memcache_pool_maxsize = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.483009 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.483563 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.484074 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.memcache_socket_timeout = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.484582 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.proxies = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.485124 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.tls_allowed_ciphers = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.485570 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.tls_cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.486056 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.tls_certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.486577 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.tls_enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.487068 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cache.tls_keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.487608 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.auth_section = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.488155 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.auth_type = password {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.488649 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.489221 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.catalog_info = volumev3::publicURL {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.489717 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.490247 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.490750 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.cross_az_attach = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.491238 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.endpoint_template = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.491743 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.http_retries = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.492265 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.492749 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.493256 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.os_region_name = RegionOne {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.493760 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.494286 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cinder.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.494805 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.495288 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.cpu_dedicated_set = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.495768 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.cpu_shared_set = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.496258 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.496742 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.497239 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.497732 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.498254 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.resource_provider_association_refresh = 300 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.498742 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] compute.shutdown_retry_interval = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.499271 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] conductor.workers = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.499773 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] console.allowed_origins = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.500265 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] console.ssl_ciphers = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.500762 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] console.ssl_minimum_version = default {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.501267 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] consoleauth.token_ttl = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.501797 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.502304 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.502812 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.503292 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.connect_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.504036 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.connect_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.504516 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.endpoint_override = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.505004 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.505499 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.505978 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.max_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.506488 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.min_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.506967 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.region_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.507484 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.service_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.508012 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.service_type = accelerator {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.508494 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.508973 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.status_code_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.509451 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.status_code_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.509934 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.510488 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.510987 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] cyborg.version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.511525 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.backend = sqlalchemy {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.512071 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.connection = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.512568 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.connection_debug = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.513070 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.connection_parameters = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.513587 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.connection_recycle_time = 3600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.514079 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.connection_trace = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.514590 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.db_inc_retry_interval = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.515072 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.db_max_retries = 20 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.515563 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.db_max_retry_interval = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.516050 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.db_retry_interval = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.516570 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.max_overflow = 50 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.517070 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.max_pool_size = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.517563 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.max_retries = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.518049 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.mysql_enable_ndb = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.518566 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.519054 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.pool_timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.519561 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.retry_interval = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.520059 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.slave_connection = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.520556 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.sqlite_synchronous = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.521040 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.use_db_reconnect = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.521539 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] database.use_tpool = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.522082 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.connection = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.522598 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.connection_debug = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.523093 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.connection_parameters = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.524102 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.connection_recycle_time = 3600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.524582 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.connection_trace = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.525057 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.max_overflow = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.525536 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.max_pool_size = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.526023 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.max_retries = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.526533 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.527011 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.pool_timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.527499 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.retry_interval = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.527986 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.slave_connection = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.528466 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] api_database.sqlite_synchronous = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.528986 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] devices.enabled_vgpu_types = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.529489 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.529967 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ephemeral_storage_encryption.enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.530489 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.531015 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.allowed_direct_url_schemes = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.531504 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.api_servers = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.531984 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.532473 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.532985 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.533473 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.connect_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.533948 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.connect_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.534469 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.debug = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.535236 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.default_trusted_certificate_ids = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.535726 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.enable_certificate_validation = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.536205 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.enable_rbd_download = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.536680 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.endpoint_override = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.537173 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.537650 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.538126 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.max_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.538624 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.min_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.539678 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.num_retries = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.540175 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.rbd_ceph_conf = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.540661 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.rbd_connect_timeout = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.541161 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.rbd_pool = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.541650 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.rbd_user = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.542127 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.region_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.542633 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.service_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.543144 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.service_type = image {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.543642 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.544123 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.status_code_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.544601 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.status_code_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.545081 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.545611 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.546097 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.verify_glance_signatures = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.546600 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] glance.version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.547093 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] guestfs.debug = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.547633 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.config_drive_cdrom = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.548117 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.config_drive_inject_password = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.548606 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.549095 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.549599 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.enable_remotefx = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.550084 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.instances_path_share = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.550588 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.iscsi_initiator_list = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.551087 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.limit_cpu_features = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.551568 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.552051 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.552576 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.553014 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.553518 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.553997 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.use_multipath_io = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.554522 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.555001 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.555493 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.vswitch_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.555974 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.556476 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] mks.enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.557630 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.558131 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] image_cache.manager_interval = 2400 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.558640 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] image_cache.precache_concurrency = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.559527 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] image_cache.remove_unused_base_images = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.559527 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.560087 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.560595 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] image_cache.subdirectory_name = _base {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.561124 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.api_max_retries = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.561613 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.api_retry_interval = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.562105 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.auth_section = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.562621 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.auth_type = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.563105 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.563581 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.564060 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.564555 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.connect_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.565037 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.connect_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.565521 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.endpoint_override = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.566007 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.566504 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.566979 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.max_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.567461 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.min_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.567969 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.partition_key = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.568457 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.peer_list = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.568934 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.region_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.569419 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.serial_console_state_timeout = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.569894 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.service_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.570460 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.service_type = baremetal {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.570944 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.571430 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.status_code_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.571900 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.status_code_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.572378 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.572895 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.573412 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ironic.version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.573917 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.574454 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] key_manager.fixed_key = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.575012 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.575497 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.barbican_api_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.575984 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.barbican_endpoint = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.576505 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.barbican_endpoint_type = public {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.576991 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.577473 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.577959 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.578463 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.578951 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.number_of_retries = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.retry_delay = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.verify_ssl = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] barbican.verify_ssl_path = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582330 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.approle_role_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582955 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.approle_secret_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.582955 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.583598 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.584002 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.584455 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.584932 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.585429 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.kv_mountpoint = secret {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.586503 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.kv_version = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.586940 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.root_token_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.587430 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.587902 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.ssl_ca_crt_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.588377 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.588858 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.use_ssl = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.589381 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.589917 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.590438 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.590927 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.591413 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.connect_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.591891 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.connect_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.592373 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.endpoint_override = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.592855 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.593775 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.593775 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.max_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.594224 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.min_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.594701 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.region_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.595204 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.service_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.595704 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.service_type = identity {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.596191 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.596682 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.status_code_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.597171 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.status_code_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.597643 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.598182 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.598662 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] keystone.version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.599237 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.connection_uri = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.599730 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.cpu_mode = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.600221 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.cpu_model_extra_flags = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.600774 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.cpu_models = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.601278 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.disk_cachemodes = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.602361 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.disk_prefix = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.602831 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.enabled_perf_events = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.603280 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.file_backed_memory = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.603720 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.gid_maps = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.604186 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.hw_disk_discard = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.604620 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.hw_machine_type = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.605079 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_rbd_ceph_conf = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.605526 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.605992 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.606471 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_rbd_glance_store_name = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.606944 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_rbd_pool = rbd {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.607427 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_type = default {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.607869 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.images_volume_group = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.608314 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.inject_key = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.608758 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.inject_partition = -2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.609207 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.inject_password = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.609663 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.iscsi_iface = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.610109 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.iser_use_multipath = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.610587 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.611032 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.611475 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_downtime = 500 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.611918 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.612365 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.612837 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_inbound_addr = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.613282 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.613772 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.614279 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_scheme = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.614648 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_timeout_action = abort {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.615097 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_tunnelled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.615535 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_uri = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.615976 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.live_migration_with_native_tls = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.616425 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.max_queues = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.616920 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.617366 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.nfs_mount_options = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.617950 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.618419 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.618865 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.num_iser_scan_tries = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.619342 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.619771 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.620215 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.num_pcie_ports = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.620667 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.num_volume_scan_tries = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.621118 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.pmem_namespaces = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.621574 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.quobyte_client_cfg = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.622138 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.622610 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rbd_connect_timeout = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.623058 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.623504 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.623932 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rbd_secret_uuid = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.624499 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rbd_user = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.624813 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.625273 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.625777 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rescue_image_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.626265 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rescue_kernel_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.626752 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rescue_ramdisk_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.627286 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.627917 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.rx_queue_size = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.628795 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.smbfs_mount_options = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.629523 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.630181 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.snapshot_compression = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.630816 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.snapshot_image_format = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.631519 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.632149 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.sparse_logical_volumes = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.632806 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.swtpm_enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.633436 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.swtpm_group = tss {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.634064 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.swtpm_user = tss {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.634738 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.sysinfo_serial = unique {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.635357 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.tx_queue_size = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.636252 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.uid_maps = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.636882 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.use_usb_tablet = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.637522 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.use_virtio_for_bridges = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.638179 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.virt_type = kvm {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.638819 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.volume_clear = zero {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.639453 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.volume_clear_size = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.640090 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.volume_use_multipath = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.640717 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_cache_path = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.641348 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.641988 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_mount_group = qemu {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.642629 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_mount_opts = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.643277 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.643921 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.644351 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.vzstorage_mount_user = stack {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.644804 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.645274 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.645748 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.auth_section = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.646231 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.auth_type = password {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.646676 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.647123 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.647582 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.648025 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.connect_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.648994 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.connect_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.649451 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.default_floating_pool = public {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.649890 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.endpoint_override = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.650369 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.extension_sync_interval = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.650816 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.http_retries = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.651265 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.651702 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.652139 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.max_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.652600 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.653036 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.min_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.653493 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.ovs_bridge = br-int {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.654011 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.physnets = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.654467 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.region_name = RegionOne {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.654932 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.service_metadata_proxy = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.655286 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.service_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.655740 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.service_type = network {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.656184 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.656625 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.status_code_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.657061 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.status_code_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.657507 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.657983 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.658445 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] neutron.version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.658911 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] notifications.bdms_in_notifications = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.659392 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] notifications.default_level = INFO {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.659877 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] notifications.notification_format = unversioned {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.660303 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] notifications.notify_on_state_change = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.660770 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.661239 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] pci.alias = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.661692 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] pci.passthrough_whitelist = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.662197 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.auth_section = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.662680 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.auth_type = password {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.663399 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.auth_url = http://10.222.0.31/identity {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.664809 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.665177 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.665713 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.666078 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.connect_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.666541 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.connect_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.667041 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.default_domain_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.667452 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.default_domain_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.667906 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.domain_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.668361 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.domain_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.668804 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.endpoint_override = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.669250 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.669693 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.670130 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.max_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.670588 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.min_version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.671055 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.password = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.671501 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.project_domain_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.671958 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.project_domain_name = Default {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.672404 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.project_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.672870 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.project_name = service {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.673343 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.region_name = RegionOne {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.673791 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.service_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.674271 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.service_type = placement {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.674726 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.675251 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.status_code_retries = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.675578 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.status_code_retry_delay = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.676014 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.system_scope = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.676453 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.676897 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.trust_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.677336 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.user_domain_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.677792 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.user_domain_name = Default {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.678249 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.user_id = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.678712 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.username = placement {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.679187 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.679701 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] placement.version = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.680172 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] powervm.disk_driver = localdisk {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.680630 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] powervm.proc_units_factor = 0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.681081 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] powervm.volume_group_name = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.681556 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.cores = 20 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.682000 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.count_usage_from_placement = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.682493 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.682960 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.injected_file_content_bytes = 10240 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.683414 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.injected_file_path_length = 255 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.683874 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.injected_files = 5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.684335 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.instances = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.684791 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.key_pairs = 100 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.685395 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.metadata_items = 128 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.685686 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.ram = 51200 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.686127 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.recheck_quota = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.686591 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.server_group_members = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.687057 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] quota.server_groups = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.687511 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rdp.enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.688239 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.688737 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.689213 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.driver = filter_scheduler {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.689666 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.690121 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.image_metadata_prefilter = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.690590 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.691044 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.max_attempts = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.691488 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.max_placement_results = 1000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.691937 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.periodic_task_interval = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.692387 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.692832 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.query_placement_for_availability_zone = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.693275 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.693731 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] scheduler.workers = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.694281 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.694699 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.695305 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.695758 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.696206 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.696659 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.697112 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.697614 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.698075 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.host_subset_size = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.698538 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.698990 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.699451 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.isolated_hosts = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.699908 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.isolated_images = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.700362 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.700808 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.701259 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.701718 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.702186 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.702640 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.703089 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.703538 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.704003 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.track_instance_changes = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.704476 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.705006 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metrics.required = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.705381 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metrics.weight_multiplier = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.705826 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.706295 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] metrics.weight_setting = [] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.706935 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.707382 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] serial_console.enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.707873 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] serial_console.port_range = 10000:20000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.708341 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.708801 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.709251 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] serial_console.serialproxy_port = 6083 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.709698 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.auth_section = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.710181 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.auth_type = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.710620 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.711567 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.712019 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.712481 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.712939 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.713450 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.send_service_user_token = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.713892 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.714352 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] service_user.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.714819 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.agent_enabled = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.715461 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.715967 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.716522 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.716977 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.html5proxy_port = 6082 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.717438 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.server_listen = 127.0.0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.717902 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.718371 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] upgrade_levels.baseapi = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.718810 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] upgrade_levels.cert = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.719268 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] upgrade_levels.compute = auto {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.719710 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] upgrade_levels.conductor = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.720153 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] upgrade_levels.scheduler = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.720602 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.721056 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.721495 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.cafile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.721933 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.certfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.722397 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.722841 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.723278 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.723724 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.724164 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vendordata_dynamic_auth.timeout = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.724664 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.api_retry_count = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.725118 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.ca_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.725570 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.cache_prefix = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.726009 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.cluster_name = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.727079 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.connection_pool_size = 10 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.727523 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.console_delay_seconds = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.727972 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.datastore_regex = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.728416 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.host_ip = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.728857 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.host_password = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.729306 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.host_port = 443 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.729746 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.host_username = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.730209 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.insecure = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.730656 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.integration_bridge = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.731100 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.maximum_objects = 100 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.731541 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.pbm_default_policy = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.731982 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.pbm_enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.732422 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.pbm_wsdl_location = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.732882 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.733320 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.serial_port_proxy_uri = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.733757 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.serial_port_service_uri = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.734237 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.task_poll_interval = 0.5 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.734684 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.use_linked_clone = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.735141 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.vnc_keymap = en-us {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.735599 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.vnc_port = 5900 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.736080 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vmware.vnc_port_total = 10000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.736590 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.auth_schemes = ['none'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.737318 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.enabled = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.738009 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.738517 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.738947 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.novncproxy_port = 6080 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.739422 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.server_listen = 127.0.0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.739912 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.740358 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.vencrypt_ca_certs = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.740796 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.vencrypt_client_cert = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.741235 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] vnc.vencrypt_client_key = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.741694 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.742191 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.742629 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.743087 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.disable_native_luksv1 = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.743534 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.disable_rootwrap = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.743980 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.enable_numa_live_migration = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.744425 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.744877 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.745323 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.745779 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.rbd_volume_local_attach = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.746252 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.746738 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.747211 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.client_socket_timeout = 900 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.747664 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.default_pool_size = 1000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.748126 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.keep_alive = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.748651 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.max_header_line = 16384 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.749029 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.secure_proxy_ssl_header = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.749478 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.ssl_ca_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.749923 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.ssl_cert_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.750392 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.ssl_key_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.750846 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.tcp_keepidle = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.751316 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.751764 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] zvm.ca_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.752201 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] zvm.cloud_connector_url = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.752752 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.753200 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] zvm.reachable_timeout = 300 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.753979 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.enforce_new_defaults = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.754507 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.enforce_scope = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.754910 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.policy_default_rule = default {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.755412 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.755881 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.policy_file = policy.yaml {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.756368 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.756822 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.757260 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.757753 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.758220 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.758799 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.759208 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.connection_string = messaging:// {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.759676 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.enabled = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.760148 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.es_doc_type = notification {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.760611 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.es_scroll_size = 10000 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.761069 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.es_scroll_time = 2m {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.761514 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.filter_error_trace = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.761986 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.hmac_keys = SECRET_KEY {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.762464 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.sentinel_service_name = mymaster {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.762943 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.socket_timeout = 0.1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.763388 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] profiler.trace_sqlalchemy = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.763870 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] remote_debug.host = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.764312 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] remote_debug.port = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.764791 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.765243 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.765949 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.766238 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.766614 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.767064 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.767522 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.767996 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.768461 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.768942 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.769376 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.769830 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.770323 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.770778 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.771228 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.771699 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.772143 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.772602 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.773047 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.774044 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.774512 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.774975 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.ssl = False {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.775437 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.775918 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.776366 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.776841 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.777355 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.777808 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_notifications.retry = -1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.778324 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.778786 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.779269 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_reports.file_event_handler = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.779726 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.780184 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] oslo_reports.log_dir = None {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:35:19.780559 n-d-821350-1 nova-conductor[88936]: DEBUG oslo_service.service [None req-1ecafc79-ea92-41a4-bae6-42bd605fdef6 None None] ******************************************************************************** {{(pid=88936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 18:38:19.414749 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:38:19.472037 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:38:20.436635 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36134. Dec 16 18:38:20.504864 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36136. Dec 16 18:41:20.433287 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:41:20.490104 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:41:21.456076 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36196. Dec 16 18:41:21.510349 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36198. Dec 16 18:44:21.451080 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:44:21.508629 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:44:22.476058 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36314. Dec 16 18:44:22.533240 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36316. Dec 16 18:44:49.603538 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Parent process 88936 forked (89821) with an open database connection, which is being discarded and recreated. {{(pid=89821) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Dec 16 18:44:51.921135 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Took 2.30 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:44:51.976480 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:51.980669 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.001650 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:52.108580 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.110099 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.110991 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.111408 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.137462 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:52.161080 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Getting quotas for project 6bf457e8913645148db8f91c0f065224. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:44:52.166581 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Getting quotas for user 5a8431485fb347188ff144c3400a63be and project 6bf457e8913645148db8f91c0f065224. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:44:52.179327 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] [instance: 505f1ede-4b4a-42b6-8380-63525bb01ca3] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:44:52.180567 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.181042 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.197048 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] [instance: 505f1ede-4b4a-42b6-8380-63525bb01ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:44:52.199994 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.200416 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.251680 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.252686 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.253602 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f1e46850-a952-4513-b05f-70e6cb4efd19 tempest-AggregatesAdminTestJSON-1912839210 tempest-AggregatesAdminTestJSON-1912839210-project] Acquired lock "compute-rpcapi-router" {{(pid=89821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 18:44:52.254681 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-64cb3cde-6b3a-4814-9152-44e55b427a51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.255153 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-64cb3cde-6b3a-4814-9152-44e55b427a51 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.256593 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-64cb3cde-6b3a-4814-9152-44e55b427a51 None None] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:52.257614 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-64cb3cde-6b3a-4814-9152-44e55b427a51 None None] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:52.267044 n-d-821350-1 nova-conductor[89821]: INFO nova.compute.rpcapi [None req-64cb3cde-6b3a-4814-9152-44e55b427a51 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 18:44:52.268678 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-64cb3cde-6b3a-4814-9152-44e55b427a51 None None] Releasing lock "compute-rpcapi-router" {{(pid=89821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 18:45:03.294259 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_db.sqlalchemy.engines [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Parent process 88936 forked (89822) with an open database connection, which is being discarded and recreated. {{(pid=89822) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Dec 16 18:45:04.403966 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Took 1.09 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:45:04.569924 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:04.577899 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:04.618596 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_db.sqlalchemy.engines [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:45:04.864355 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:04.870054 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:04.878815 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:04.879501 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:04.929487 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_db.sqlalchemy.engines [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:45:04.972757 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Getting quotas for project 2d56ac6d5dca4fe98aa8572145f51e6e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:45:04.985819 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Getting quotas for user 8091e23a0c8242d395b934af33d5cc14 and project 2d56ac6d5dca4fe98aa8572145f51e6e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:45:05.014295 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] [instance: 692708f7-2f2b-4153-9c0f-5067929cb3c4] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:45:05.018248 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:05.022111 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:05.035266 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] [instance: 692708f7-2f2b-4153-9c0f-5067929cb3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:45:05.042471 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:05.043644 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:05.149419 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:05.151022 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:05.151899 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-83fdff8d-9b8f-4b28-babd-177e52c5d7dc tempest-ServerDiagnosticsNegativeTest-1345550103 tempest-ServerDiagnosticsNegativeTest-1345550103-project] Acquired lock "compute-rpcapi-router" {{(pid=89822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 18:45:05.155686 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96b4905f-dc30-4193-8972-5e6bd4517061 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:05.156580 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96b4905f-dc30-4193-8972-5e6bd4517061 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:05.161804 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96b4905f-dc30-4193-8972-5e6bd4517061 None None] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:05.162712 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96b4905f-dc30-4193-8972-5e6bd4517061 None None] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:05.190990 n-d-821350-1 nova-conductor[89822]: INFO nova.compute.rpcapi [None req-96b4905f-dc30-4193-8972-5e6bd4517061 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 18:45:05.194928 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96b4905f-dc30-4193-8972-5e6bd4517061 None None] Releasing lock "compute-rpcapi-router" {{(pid=89822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 18:45:31.961466 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:45:32.048590 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:32.049042 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:32.165798 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:32.168083 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:32.170587 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:32.173759 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:32.226519 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:45:32.234982 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for user ad65d9818b964eeb9c0c89ab5c65d265 and project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:45:32.285405 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: aae1bafa-6b7f-4966-82cf-3a48a4290886] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:45:32.287731 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:32.288681 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:32.306992 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: aae1bafa-6b7f-4966-82cf-3a48a4290886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:45:32.314454 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:32.327706 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:32.416938 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:32.417365 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e3b69826-e49b-41da-83af-c685e013f57c tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:57.407164 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Took 0.77 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:45:57.507385 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:57.507385 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:57.652013 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:57.661646 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:57.664952 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:57.677493 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:57.750064 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Getting quotas for project 7524aadbb11648628f9641aa9c25b021. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:45:57.762174 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Getting quotas for user 042d2cdf882a4b008c35fcdebb4d5186 and project 7524aadbb11648628f9641aa9c25b021. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:45:57.811681 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] [instance: d322c3b1-1838-488d-9f3c-4eef8ee0fe1c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:45:57.813567 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:57.820799 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:57.840727 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] [instance: d322c3b1-1838-488d-9f3c-4eef8ee0fe1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:45:57.842268 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:57.842921 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:45:57.936115 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:45:57.936858 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-782617d6-e888-4e39-96a3-5accfbbbc057 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:00.932307 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:00.976183 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:01.000986 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:01.192365 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:01.192770 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:01.194600 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:01.201594 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:01.290990 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Getting quotas for project 1c132cd92a374bfcaada88b1a31e6a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:01.299250 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Getting quotas for user 88d34d06d5f54f75a448dfeedaa9107d and project 1c132cd92a374bfcaada88b1a31e6a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:01.359368 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: eef26bcd-211d-4402-bb5f-5ffa178dae6c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:01.368234 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:01.369080 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:01.390553 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: eef26bcd-211d-4402-bb5f-5ffa178dae6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:01.393605 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:01.394272 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:01.459704 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:01.460596 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca8985bb-acb2-4d57-b291-2795b2fc1736 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:02.852938 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:02.894809 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:02.895218 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:02.996597 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:02.997297 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:02.998342 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:02.999068 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:03.020541 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Getting quotas for project 1c132cd92a374bfcaada88b1a31e6a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:03.024964 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Getting quotas for user 88d34d06d5f54f75a448dfeedaa9107d and project 1c132cd92a374bfcaada88b1a31e6a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:03.038835 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: 343e128c-9476-465f-8945-c3d75b16f6b0] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:03.040257 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:03.040923 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:03.053442 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: 343e128c-9476-465f-8945-c3d75b16f6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:03.055518 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:03.056159 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:03.154212 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:03.155210 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a0f9bd37-c2ee-4087-83b2-3042ee81e9a9 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:03.981432 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-72b8b6a5-4c5e-47f6-a3e8-c259c647b135 tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:46:03.983307 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-72b8b6a5-4c5e-47f6-a3e8-c259c647b135 tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:03.985246 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-72b8b6a5-4c5e-47f6-a3e8-c259c647b135 tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:05.208289 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-72b8b6a5-4c5e-47f6-a3e8-c259c647b135 tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] [instance: aae1bafa-6b7f-4966-82cf-3a48a4290886] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:46:05.882644 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-72b8b6a5-4c5e-47f6-a3e8-c259c647b135 tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Created allocations for migration de6ea1c9-7d30-4d9f-93ea-457f451004f3 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:46:06.292683 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-72b8b6a5-4c5e-47f6-a3e8-c259c647b135 tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] [instance: aae1bafa-6b7f-4966-82cf-3a48a4290886] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:46:07.046614 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:07.115696 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:07.117762 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:07.278865 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:07.279521 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:07.280947 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:07.282062 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:07.300163 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:07.304405 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for user fc9cf57aad9e44d6bfd4f07f6c56eaa4 and project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:07.314760 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: 7cd01a09-b574-4f63-ae07-f680d466cd36] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:07.315965 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:07.316626 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:07.327738 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: 7cd01a09-b574-4f63-ae07-f680d466cd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:07.330470 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:07.331085 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:07.385952 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:07.386540 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2f9d7962-2369-45ca-b195-a2fa12849ad5 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:29.681708 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:29.788016 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:29.788433 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:29.797718 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:29.825884 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:29.826329 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:29.915192 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:29.915926 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:29.917228 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:29.917820 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:29.956435 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Getting quotas for project 7524aadbb11648628f9641aa9c25b021. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:29.962659 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Getting quotas for user 042d2cdf882a4b008c35fcdebb4d5186 and project 7524aadbb11648628f9641aa9c25b021. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:29.982284 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] [instance: 1498b8f7-366c-4af5-bfe2-66b4837c4351] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:29.983528 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:29.984878 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:29.995727 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] [instance: 1498b8f7-366c-4af5-bfe2-66b4837c4351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:30.002724 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.003333 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:30.038582 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.039304 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:30.040249 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.040643 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:30.061143 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.061578 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fcac8d54-2dbb-4a7a-93c2-c69fe6cf7515 tempest-DeleteServersAdminTestJSON-2029742208 tempest-DeleteServersAdminTestJSON-2029742208-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:30.082622 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Getting quotas for project 7533c948015941c3b9bd56d07668982c. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:30.089134 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Getting quotas for user c5d5cbf480e94016b294eaf275888816 and project 7533c948015941c3b9bd56d07668982c. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:30.131250 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: 4e4a3103-5d25-4c1a-bbd8-f09494d64161] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:30.132436 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.132988 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:30.157642 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: 4e4a3103-5d25-4c1a-bbd8-f09494d64161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:30.159489 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.160075 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:30.219765 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:30.220408 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9a329439-eb66-4559-90df-d91464eae3ca tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:35.598806 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:35.652799 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:35.654657 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:35.778904 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:35.779588 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:35.780519 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:35.781550 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:35.818463 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Getting quotas for project 69364e5997f54edf97dbe62e3e279ce2. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:35.823470 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Getting quotas for user 4a86d5b821bc425ca82930d4662d17ce and project 69364e5997f54edf97dbe62e3e279ce2. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:35.835497 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] [instance: 3465fc3e-1ad2-4a2d-8ce0-28b86de13765] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:35.836734 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:35.837287 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:35.849765 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] [instance: 3465fc3e-1ad2-4a2d-8ce0-28b86de13765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a220c4f5-a785-4049-beb5-a7f588a1fea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:35.851459 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:35.852181 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:35.913442 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:35.913860 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-7cfc96f0-0649-47ce-83e7-85e3d90a106e tempest-AttachSCSIVolumeTestJSON-172660999 tempest-AttachSCSIVolumeTestJSON-172660999-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:41.260516 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:46:41.310636 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:41.312554 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:41.428254 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:41.428786 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:41.429502 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:41.429886 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:41.479466 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Getting quotas for project 1c132cd92a374bfcaada88b1a31e6a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:46:41.486091 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Getting quotas for user 88d34d06d5f54f75a448dfeedaa9107d and project 1c132cd92a374bfcaada88b1a31e6a1a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:46:41.506291 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: 9b978590-67c8-4b2d-b57b-8cca9e768950] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:46:41.508096 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:41.508644 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:41.521299 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: 9b978590-67c8-4b2d-b57b-8cca9e768950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:46:41.523140 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:41.524080 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:41.575002 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:41.576343 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-53c924f7-245f-4073-b5d0-6c19aa44952e tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:48.442735 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:46:48.451195 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:48.452563 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:49.440937 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Created allocations for migration 49f83e21-53f9-436c-85af-dc4e2b4bf79c on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:46:49.863548 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: 7cd01a09-b574-4f63-ae07-f680d466cd36] Instance allocations successfully created on destination node 2ec5f0ed-a520-4003-9f1a-57c72c316219: {'allocations': {'2ec5f0ed-a520-4003-9f1a-57c72c316219': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89821) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:46:49.865534 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'resources' on Instance uuid 7cd01a09-b574-4f63-ae07-f680d466cd36 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:46:49.873267 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'pci_requests' on Instance uuid 7cd01a09-b574-4f63-ae07-f680d466cd36 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:46:51.827869 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.live_migrate [None req-73c4ea64-7b9a-46af-ae6c-aaeeccd99b14 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: 7cd01a09-b574-4f63-ae07-f680d466cd36] Start binding ports on destination host: n-h2-821350-1 {{(pid=89821) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:46:58.396564 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-705d560f-d5ce-4420-b13b-aa2608fdb8f0 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:46:58.397180 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-705d560f-d5ce-4420-b13b-aa2608fdb8f0 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:46:58.397780 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-705d560f-d5ce-4420-b13b-aa2608fdb8f0 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:46:58.441513 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-705d560f-d5ce-4420-b13b-aa2608fdb8f0 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: 4e4a3103-5d25-4c1a-bbd8-f09494d64161] No migration record for the rebuild/evacuate request. {{(pid=89822) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:47:03.923634 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:47:04.011932 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:04.012646 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:04.173842 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:04.174506 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:04.175648 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:04.176275 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:04.212890 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:47:04.229776 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for user ad65d9818b964eeb9c0c89ab5c65d265 and project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:47:04.261983 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b348ecb1-f355-4cb1-8c70-a79ef8f9a176] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:47:04.263369 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:04.264014 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:04.277184 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b348ecb1-f355-4cb1-8c70-a79ef8f9a176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:47:04.279662 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:04.280541 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:04.331041 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:04.331782 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a9a2c3b2-b010-49f2-ad03-1b9640ffeaa8 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:06.843464 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:47:06.897030 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:06.897753 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:06.989374 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:06.989928 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:06.992042 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:06.993061 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:07.020143 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Getting quotas for project fb7498687af746e08bad3d683ef8de27. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:47:07.025298 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Getting quotas for user bca1a5a50c864aa9aa84dc484041301e and project fb7498687af746e08bad3d683ef8de27. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:47:07.040468 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] [instance: 86e61526-c282-4c0b-88bd-da3994d29fe7] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:47:07.041777 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:07.042309 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:07.051262 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] [instance: 86e61526-c282-4c0b-88bd-da3994d29fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:47:07.053603 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:07.054491 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:07.103202 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:07.104023 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-654dd9d1-866a-4bb2-881d-2d2c09e120dc tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:09.734762 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:47:09.779371 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:09.780398 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:09.881630 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:09.886446 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:09.895102 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:09.895954 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:09.929119 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Getting quotas for project 52e9f1433e874cdd9ae40bdf34d5270f. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:47:09.934017 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Getting quotas for user 13d22317284b4722b413b0893432b6ed and project 52e9f1433e874cdd9ae40bdf34d5270f. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:47:09.958013 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] [instance: 77ade9b7-0731-4652-9fa9-06a21100d6ab] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:47:09.959022 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:09.959426 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:09.975468 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] [instance: 77ade9b7-0731-4652-9fa9-06a21100d6ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:47:09.976599 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:09.977058 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:10.044886 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:10.046433 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-47a49f3a-16b9-4136-8754-afdb16f94de9 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:24.179722 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:47:24.231196 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:24.231862 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:24.307224 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:24.307984 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:24.309056 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:24.309687 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:24.334984 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:47:24.339699 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for user fc9cf57aad9e44d6bfd4f07f6c56eaa4 and project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:47:24.363450 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: bb0d1b57-9b69-43d6-805e-60e170078e6f] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:47:24.364530 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:24.366597 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:24.382523 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: bb0d1b57-9b69-43d6-805e-60e170078e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:47:24.384023 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:24.384691 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:24.444300 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:24.444933 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1df0a67a-9e5f-423a-b0e7-fd367133100a tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:28.675456 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a14f74bd-8704-4980-ba60-04f1373a55c7 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:47:28.676396 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a14f74bd-8704-4980-ba60-04f1373a55c7 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:28.677427 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a14f74bd-8704-4980-ba60-04f1373a55c7 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:28.713265 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a14f74bd-8704-4980-ba60-04f1373a55c7 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: eef26bcd-211d-4402-bb5f-5ffa178dae6c] No migration record for the rebuild/evacuate request. {{(pid=89821) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:47:29.682323 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-afeb9140-97b2-4b9f-9fa7-f7d3bd8b0016 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:47:29.682997 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-afeb9140-97b2-4b9f-9fa7-f7d3bd8b0016 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:29.683515 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-afeb9140-97b2-4b9f-9fa7-f7d3bd8b0016 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:30.376287 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-afeb9140-97b2-4b9f-9fa7-f7d3bd8b0016 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b348ecb1-f355-4cb1-8c70-a79ef8f9a176] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89822) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:47:30.893756 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-afeb9140-97b2-4b9f-9fa7-f7d3bd8b0016 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Created allocations for migration 3ec0d4e4-cd2f-4194-a678-fb4343af475b on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:47:31.199864 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-afeb9140-97b2-4b9f-9fa7-f7d3bd8b0016 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b348ecb1-f355-4cb1-8c70-a79ef8f9a176] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"2ec5f0ed-a520-4003-9f1a-57c72c316219": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["2ec5f0ed-a520-4003-9f1a-57c72c316219"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=2ec5f0ed-a520-4003-9f1a-57c72c316219,limits=SchedulerLimits,nodename='n-h2-821350-1',service_host='n-h2-821350-1')] {{(pid=89822) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:47:41.914341 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:47:41.914838 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:41.915765 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:42.439673 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Created allocations for migration 5daf6fc9-cb27-48ed-bc5f-037bea9d7755 on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:47:42.592112 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: bb0d1b57-9b69-43d6-805e-60e170078e6f] Instance allocations successfully created on destination node 2ec5f0ed-a520-4003-9f1a-57c72c316219: {'allocations': {'2ec5f0ed-a520-4003-9f1a-57c72c316219': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89821) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:47:42.592719 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'resources' on Instance uuid bb0d1b57-9b69-43d6-805e-60e170078e6f {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:47:42.598700 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'pci_requests' on Instance uuid bb0d1b57-9b69-43d6-805e-60e170078e6f {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:47:42.980779 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.live_migrate [None req-19138977-3984-44ce-a1c5-430e9da07f1d tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: bb0d1b57-9b69-43d6-805e-60e170078e6f] Start binding ports on destination host: n-h2-821350-1 {{(pid=89821) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:47:43.964673 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:47:43.989566 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:43.990131 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:44.077771 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:44.078462 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:44.079545 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:44.080129 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:44.096582 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Getting quotas for project 7533c948015941c3b9bd56d07668982c. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:47:44.104674 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Getting quotas for user c5d5cbf480e94016b294eaf275888816 and project 7533c948015941c3b9bd56d07668982c. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:47:44.115898 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: 3233302d-84e6-4116-b03e-d5fc9a44342e] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:47:44.117138 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:44.117873 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:44.128130 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: 3233302d-84e6-4116-b03e-d5fc9a44342e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:47:44.129844 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:44.130511 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:47:44.198368 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:47:44.199022 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4d03871b-1b10-48f8-bae6-a97ce6ccbbb2 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:03.398792 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:48:03.446144 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:03.447026 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:03.501329 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:03.501744 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:03.502500 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:03.503377 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:03.525609 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:48:03.530440 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for user fc9cf57aad9e44d6bfd4f07f6c56eaa4 and project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:48:03.541681 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: 5e3993d4-8213-4189-be18-3238bc3356de] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:48:03.542950 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:03.543790 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:03.552442 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: 5e3993d4-8213-4189-be18-3238bc3356de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:48:03.554897 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:03.555859 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:03.593561 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:03.594249 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c8a3336c-1b23-4e3f-9c65-a4b26dac2a79 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:05.189059 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-18b29040-e2ba-4ba3-bf3b-b26b073234a6 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:48:05.190831 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-18b29040-e2ba-4ba3-bf3b-b26b073234a6 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:05.191504 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-18b29040-e2ba-4ba3-bf3b-b26b073234a6 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:05.223067 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-18b29040-e2ba-4ba3-bf3b-b26b073234a6 tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: 3233302d-84e6-4116-b03e-d5fc9a44342e] No migration record for the rebuild/evacuate request. {{(pid=89822) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:48:10.023689 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3c5350fd-efbd-4dc9-8cf4-de5275f65816 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:48:10.036955 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3c5350fd-efbd-4dc9-8cf4-de5275f65816 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:10.039296 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3c5350fd-efbd-4dc9-8cf4-de5275f65816 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:10.092727 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3c5350fd-efbd-4dc9-8cf4-de5275f65816 tempest-ServersAdminTestJSON-318167844 tempest-ServersAdminTestJSON-318167844-project] [instance: eef26bcd-211d-4402-bb5f-5ffa178dae6c] No migration record for the rebuild/evacuate request. {{(pid=89821) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:48:15.551826 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:48:15.587873 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:15.588686 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:15.647447 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:15.648167 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:15.649038 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:15.649576 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:15.671761 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Getting quotas for project 52e9f1433e874cdd9ae40bdf34d5270f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:48:15.679580 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Getting quotas for user 13d22317284b4722b413b0893432b6ed and project 52e9f1433e874cdd9ae40bdf34d5270f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:48:15.692567 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] [instance: 1f9b7b5c-1a18-4c89-a213-e2d42be9e80b] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:48:15.693865 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:15.694653 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:15.704373 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] [instance: 1f9b7b5c-1a18-4c89-a213-e2d42be9e80b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:48:15.706800 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:15.707490 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:15.759047 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:15.759621 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a1ab70ac-6b5d-42f2-b91c-635e060ca809 tempest-ServersTestMultiNic-502314212 tempest-ServersTestMultiNic-502314212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:27.942069 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:48:28.024798 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:28.027072 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:28.127639 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:28.128049 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:28.129572 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:28.132009 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:28.158689 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:48:28.165235 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for user ad65d9818b964eeb9c0c89ab5c65d265 and project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:48:28.187443 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b3362b93-eca3-4aa9-9ac6-464d5c5df297] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:48:28.188768 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:28.189519 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:28.210769 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b3362b93-eca3-4aa9-9ac6-464d5c5df297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:48:28.212188 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:28.212724 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:28.256806 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:28.257312 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-824dd247-a6c3-490f-aba9-cf5eb0c9ad6e tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:34.147706 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:48:34.182702 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:34.183120 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:34.271002 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:34.271526 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:34.272283 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:34.272868 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:34.290688 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Getting quotas for project 7533c948015941c3b9bd56d07668982c. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:48:34.295363 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Getting quotas for user c5d5cbf480e94016b294eaf275888816 and project 7533c948015941c3b9bd56d07668982c. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:48:34.306064 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: d29a1f4e-dea6-439f-ad4d-2d23cca5b4f8] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:48:34.307348 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:34.307933 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:34.322571 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] [instance: d29a1f4e-dea6-439f-ad4d-2d23cca5b4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:48:34.323838 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:34.324266 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:34.388774 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:34.389292 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d743a4-bcb2-4a72-a3fc-c6f85201aa4b tempest-ServerDiskConfigTestJSON-928568387 tempest-ServerDiskConfigTestJSON-928568387-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:44.235193 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:48:44.235883 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:44.236097 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:44.666271 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Created allocations for migration cd644cfa-453e-4ea0-a79f-83265770ae37 on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:48:44.842345 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: 5e3993d4-8213-4189-be18-3238bc3356de] Instance allocations successfully created on destination node 2ec5f0ed-a520-4003-9f1a-57c72c316219: {'allocations': {'2ec5f0ed-a520-4003-9f1a-57c72c316219': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89821) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:48:44.842933 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'resources' on Instance uuid 5e3993d4-8213-4189-be18-3238bc3356de {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:48:44.848300 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'pci_requests' on Instance uuid 5e3993d4-8213-4189-be18-3238bc3356de {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:48:45.205066 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.live_migrate [None req-49f8edb1-9e2e-41c0-927b-071eae0a7f5c tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: 5e3993d4-8213-4189-be18-3238bc3356de] Start binding ports on destination host: n-h2-821350-1 {{(pid=89821) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:48:50.765679 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:48:50.805718 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:50.806272 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:50.870139 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:50.871561 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:50.873449 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:50.873855 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:50.898023 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Getting quotas for project 8b6211868ccf44dfb47018f77751ff56. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:48:50.902403 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Getting quotas for user 22159c088a954b64a794ffc99d11b272 and project 8b6211868ccf44dfb47018f77751ff56. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:48:50.913846 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] [instance: 84d839bc-bfcb-4f2e-b26d-9639ee79bc60] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:48:50.914842 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:50.915236 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:50.924014 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] [instance: 84d839bc-bfcb-4f2e-b26d-9639ee79bc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:48:50.925508 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:50.926057 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:50.987804 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:50.988166 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-85a6c25a-3b62-44d6-aa0c-92fc7e5b0faa tempest-FloatingIPsAssociationNegativeTestJSON-1936644954 tempest-FloatingIPsAssociationNegativeTestJSON-1936644954-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:58.875545 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-112d302a-b118-479a-b8e5-c4c1474e3c0b tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:48:58.876771 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-112d302a-b118-479a-b8e5-c4c1474e3c0b tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:48:58.878476 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-112d302a-b118-479a-b8e5-c4c1474e3c0b tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:48:59.225788 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-112d302a-b118-479a-b8e5-c4c1474e3c0b tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b3362b93-eca3-4aa9-9ac6-464d5c5df297] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:48:59.641627 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-112d302a-b118-479a-b8e5-c4c1474e3c0b tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Created allocations for migration 06c6bbef-d770-4ca9-8dad-8582c9510da0 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:48:59.913790 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-112d302a-b118-479a-b8e5-c4c1474e3c0b tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: b3362b93-eca3-4aa9-9ac6-464d5c5df297] Calling prep_resize with selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"f3e8aa33-a634-4f3a-8683-94d69edc9cc6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["f3e8aa33-a634-4f3a-8683-94d69edc9cc6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=f3e8aa33-a634-4f3a-8683-94d69edc9cc6,limits=SchedulerLimits,nodename='n-h1-821350-1',service_host='n-h1-821350-1')] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:49:27.538695 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:49:27.628260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:27.629693 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:27.766918 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:27.767327 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:27.770999 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:27.771393 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:27.812521 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Getting quotas for project 26ec85b462cd4caf89836de3b8e1cd20. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:49:27.826611 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Getting quotas for user 89ddceed3d5b4f63b8876de311b5b493 and project 26ec85b462cd4caf89836de3b8e1cd20. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:49:27.842881 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] [instance: a6e00055-ebaf-4e1f-9a21-234894eab7f8] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:49:27.844120 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:27.844685 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:27.857237 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] [instance: a6e00055-ebaf-4e1f-9a21-234894eab7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:49:27.858958 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:27.859548 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:27.944900 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:27.945260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c303dec-b850-44dc-8c2a-83af42eef5f1 tempest-InstanceActionsTestJSON-1097822488 tempest-InstanceActionsTestJSON-1097822488-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:32.597674 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:49:32.668053 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:32.668471 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:32.825693 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:32.828550 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:32.829356 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:32.829756 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:32.880229 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Getting quotas for project 5d2735150e1c44ed8a4243969198f851. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:49:32.893502 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Getting quotas for user a2ddd03d974d42ef91738cdf56f16517 and project 5d2735150e1c44ed8a4243969198f851. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:49:32.911052 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] [instance: b59a3b13-7518-4dc2-abc3-e2e00a00221d] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:49:32.914924 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:32.915707 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:32.926574 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] [instance: b59a3b13-7518-4dc2-abc3-e2e00a00221d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:49:32.928208 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:32.929797 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:32.981708 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:49:32.985722 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:32.986129 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-e96514e0-f08d-4121-929d-4477a4e2cc16 tempest-VolumesAdminNegativeTest-201105072 tempest-VolumesAdminNegativeTest-201105072-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:33.038644 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:33.039311 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:33.137202 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:33.137826 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:33.138773 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:33.139315 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:33.179234 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Getting quotas for project fac49a3d6db44945845df537594d61d5. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:49:33.186947 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Getting quotas for user 783816dcdfde4b0987e2a7eac9ecaaae and project fac49a3d6db44945845df537594d61d5. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:49:33.209299 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] [instance: c87bbb39-d397-4097-b882-cf97d7c0afd8] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:49:33.212240 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:33.215800 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:33.231850 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] [instance: c87bbb39-d397-4097-b882-cf97d7c0afd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:49:33.233628 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:33.234234 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:33.289971 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:33.290713 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-246edcb8-6480-401e-bcae-e54cfc3584ac tempest-InstanceActionsV221TestJSON-1966478212 tempest-InstanceActionsV221TestJSON-1966478212-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:52.361947 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:49:52.414065 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:52.415286 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:52.527432 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:52.527832 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:52.535060 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:52.535060 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:52.570258 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:49:52.583524 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Getting quotas for user fc9cf57aad9e44d6bfd4f07f6c56eaa4 and project 1a218a05ee8e49e098320ce0e6965063. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:49:52.623790 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: 44df1658-346b-475b-8884-b6ce5296e34f] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:49:52.624854 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:52.625256 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:52.640156 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] [instance: 44df1658-346b-475b-8884-b6ce5296e34f] block_device_mapping [BlockDeviceMapping(attachment_id=cc2deebb-f70a-4356-b5ea-8ef7aee45ea2,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d7fdab3-2e74-49fe-bb4d-aa0e301cc67d',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:49:52.641862 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:52.642370 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:52.696989 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:52.698439 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3e7565eb-531d-4a84-b3b7-6cdcb1987489 tempest-LiveMigrationTest-2032292869 tempest-LiveMigrationTest-2032292869-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:57.307605 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:49:57.367863 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:57.368680 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:57.498973 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:57.499528 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:57.500540 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:57.501448 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:57.583740 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:49:57.607354 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Getting quotas for user ad65d9818b964eeb9c0c89ab5c65d265 and project 6f68db487c9c401688398b519a9b536a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:49:57.634181 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: 9e4c43c8-e8bd-4b3c-9a6f-d7f7b1bbf7d8] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:49:57.635810 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:57.636211 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:57.646791 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] [instance: 9e4c43c8-e8bd-4b3c-9a6f-d7f7b1bbf7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:49:57.650823 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:57.651690 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:49:57.694376 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:49:57.695094 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a985fbe6-90d5-45ee-8972-e3d2bf2b0182 tempest-MigrationsAdminTest-417117702 tempest-MigrationsAdminTest-417117702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.588195 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:50:13.624753 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.625837 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.695734 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.696678 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.699024 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.699599 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.724417 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Getting quotas for project fb7498687af746e08bad3d683ef8de27. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:50:13.729592 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Getting quotas for user bca1a5a50c864aa9aa84dc484041301e and project fb7498687af746e08bad3d683ef8de27. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:50:13.745659 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] [instance: 77f48ecf-d9d8-466a-bf77-662dda811814] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:50:13.746839 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.747478 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.761980 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] [instance: 77f48ecf-d9d8-466a-bf77-662dda811814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:50:13.764046 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.766048 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.785784 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.786260 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:13.834452 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:13.834860 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-5bb05077-c59b-4599-89af-8df9fce19a21 tempest-ServersWithSpecificFlavorTestJSON-1035260109 tempest-ServersWithSpecificFlavorTestJSON-1035260109-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:20.683942 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:50:20.769596 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:20.770539 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:20.961112 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:20.966446 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:20.969876 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:20.975694 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:21.098834 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Getting quotas for project b3de0cc9d47f40f3b23a90ebc92f5521. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:50:21.138242 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Getting quotas for user c36c84d1a834463193a9cace186f1935 and project b3de0cc9d47f40f3b23a90ebc92f5521. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:50:21.182109 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] [instance: b01843db-2da4-493c-8a71-4350ad458675] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:50:21.197758 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:21.198421 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:21.224991 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] [instance: b01843db-2da4-493c-8a71-4350ad458675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:50:21.227081 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:21.227726 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:21.306587 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:21.307300 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3425e273-3513-4d49-982f-6ba6b70a6a1a tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:24.059880 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:50:24.142287 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:24.143150 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:24.229652 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:24.230290 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:24.231180 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:24.231904 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:24.255814 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:50:24.272878 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for user 8d377db5b0d944168386ab7f23fc38c1 and project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:50:24.300799 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: 22c9c523-014d-4fd9-8ea7-5f102d863413] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:50:24.302814 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:24.303409 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:24.317249 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: 22c9c523-014d-4fd9-8ea7-5f102d863413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:50:24.320726 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:24.323510 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:24.380643 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:24.381118 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ec8dc6e2-c886-43e7-aa61-5f5777a3a6f1 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:26.697919 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:50:26.806029 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:26.807063 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:26.916841 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:26.917250 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:26.918610 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:26.919020 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:26.940865 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Getting quotas for project b3de0cc9d47f40f3b23a90ebc92f5521. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:50:26.945947 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Getting quotas for user c36c84d1a834463193a9cace186f1935 and project b3de0cc9d47f40f3b23a90ebc92f5521. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:50:26.958491 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] [instance: d32fd590-1c19-4a43-a1c1-5e05bf618441] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:50:26.959796 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:26.960510 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:26.971074 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] [instance: d32fd590-1c19-4a43-a1c1-5e05bf618441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:50:26.972446 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:26.973228 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:27.015914 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:27.016535 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45105395-4f48-4559-be76-c86c222436ba tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:30.302753 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:50:30.348246 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:30.348688 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:30.442793 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:30.443746 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:30.444599 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:30.445282 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:30.474675 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Getting quotas for project b3de0cc9d47f40f3b23a90ebc92f5521. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:50:30.479942 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Getting quotas for user c36c84d1a834463193a9cace186f1935 and project b3de0cc9d47f40f3b23a90ebc92f5521. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:50:30.501646 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] [instance: fbd6ea33-a584-4e9e-8159-86f25058b40a] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:50:30.503982 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:30.506223 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:30.522299 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] [instance: fbd6ea33-a584-4e9e-8159-86f25058b40a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:50:30.527504 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:30.528805 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:30.595391 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:30.598704 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ae124ea5-9710-417d-b1f7-25f78b7f252c tempest-ListServerFiltersTestJSON-1323557702 tempest-ListServerFiltersTestJSON-1323557702-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:33.714668 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fd8b858f-5e3f-4b43-a451-faf4550002bf tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:50:33.715791 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fd8b858f-5e3f-4b43-a451-faf4550002bf tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:33.716356 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fd8b858f-5e3f-4b43-a451-faf4550002bf tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:33.761624 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:50:33.762818 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:50:33.763443 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:50:34.232872 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-fd8b858f-5e3f-4b43-a451-faf4550002bf tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] [instance: 9e4c43c8-e8bd-4b3c-9a6f-d7f7b1bbf7d8] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89822) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:50:34.378630 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Created allocations for migration 44f1a66b-aff8-4e48-a4f5-cb642d58bd5d on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:50:34.596521 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: 44df1658-346b-475b-8884-b6ce5296e34f] Instance allocations successfully created on destination node f3e8aa33-a634-4f3a-8683-94d69edc9cc6: {'allocations': {'f3e8aa33-a634-4f3a-8683-94d69edc9cc6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89821) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:50:34.596959 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'resources' on Instance uuid 44df1658-346b-475b-8884-b6ce5296e34f {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:50:34.601968 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] Lazy-loading 'pci_requests' on Instance uuid 44df1658-346b-475b-8884-b6ce5296e34f {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:50:34.757598 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-fd8b858f-5e3f-4b43-a451-faf4550002bf tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] Created allocations for migration 50699a00-9ec5-4fda-864d-a3e703f419fa on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:50:35.059876 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.live_migrate [None req-ba64988a-7616-4524-bd0a-3d9e663fe913 tempest-LiveMigrationTest-1785079221 tempest-LiveMigrationTest-1785079221-project-admin] [instance: 44df1658-346b-475b-8884-b6ce5296e34f] Start binding ports on destination host: n-h1-821350-1 {{(pid=89821) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:50:35.099279 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-fd8b858f-5e3f-4b43-a451-faf4550002bf tempest-MigrationsAdminTest-1410172514 tempest-MigrationsAdminTest-1410172514-project-admin] [instance: 9e4c43c8-e8bd-4b3c-9a6f-d7f7b1bbf7d8] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:50:48.822374 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:51:40.923351 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:51:40.973840 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:40.974614 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:41.079970 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:41.080752 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:41.081751 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:41.085280 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:41.128837 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:51:41.141924 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for user 8d377db5b0d944168386ab7f23fc38c1 and project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:51:41.163949 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: dd5fca43-8ca0-4f91-b3eb-0f6626392228] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:51:41.166519 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:41.167116 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:41.189939 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: dd5fca43-8ca0-4f91-b3eb-0f6626392228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:51:41.192407 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:41.195173 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:41.263052 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:41.263507 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e8875e6b-54d9-47e1-8e3e-a321e44ba068 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:55.839872 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:51:55.879900 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:55.880309 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:55.951991 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:55.952791 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:55.954114 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:55.954972 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:55.978233 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Getting quotas for project ec20e18588ad4b698f5df1d7dc0e0c68. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:51:55.983705 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Getting quotas for user 4405f5255af1431a99c1fa794a9f3b41 and project ec20e18588ad4b698f5df1d7dc0e0c68. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:51:55.998337 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] [instance: 2d740481-1666-4d02-aafe-9f3d54d035b5] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:51:55.999583 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:56.003154 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:56.017792 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] [instance: 2d740481-1666-4d02-aafe-9f3d54d035b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:51:56.020053 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:56.020804 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:56.085402 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:56.086639 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-66482020-4de2-483f-aacd-76f8e5bd0d8f tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:58.625270 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:51:58.676692 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:58.677362 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:58.775904 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:58.776438 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:58.777586 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:58.778968 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:58.802711 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Getting quotas for project 4a3fdd9570d8426a926c8f0d88e2c52a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:51:58.807869 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Getting quotas for user 5af676d32ef24b51897a8add3c8ce0a3 and project 4a3fdd9570d8426a926c8f0d88e2c52a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:51:58.823299 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] [instance: 8721e75c-df1d-47a5-8a7f-9a533cf1b893] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:51:58.824375 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:58.824913 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:58.834369 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] [instance: 8721e75c-df1d-47a5-8a7f-9a533cf1b893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:51:58.836737 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:58.837568 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:51:58.908664 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:51:58.909153 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4b4d12e9-76d6-4632-b72f-0816f6d35d8f tempest-ServersTestJSON-944156263 tempest-ServersTestJSON-944156263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:02.868438 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:52:02.946494 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:02.946993 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:03.098779 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:03.099522 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:03.101972 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:03.102715 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:03.150923 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Getting quotas for project bfd2bdb9c48c4e9fb47ff1920fc48c74. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:52:03.177502 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Getting quotas for user 2288149025214270b2bb799ef4ef80d4 and project bfd2bdb9c48c4e9fb47ff1920fc48c74. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:52:03.213942 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] [instance: f17612b3-a097-4095-b58c-93e3a917003f] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:52:03.216941 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:03.218431 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:03.227362 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] [instance: f17612b3-a097-4095-b58c-93e3a917003f] block_device_mapping [BlockDeviceMapping(attachment_id=dcd34ebc-4437-4c5e-8127-fc6ced9aa464,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f46568b-911f-46bc-85db-a3c3191c4dba',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:52:03.229485 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:03.230052 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:03.331484 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:03.335016 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2b60a968-d0bd-4d78-a863-147e99a51a00 tempest-ServersTestBootFromVolume-1373536761 tempest-ServersTestBootFromVolume-1373536761-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:15.235984 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:52:15.289580 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:15.290355 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:15.392183 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:15.394694 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:15.395695 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:15.397279 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:15.448116 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Getting quotas for project c753cd6e976e4c78bfca367da6b23119. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:52:15.467393 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Getting quotas for user 7a4cad8c17c247a6b09ecabc86f4ffb1 and project c753cd6e976e4c78bfca367da6b23119. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:52:15.494547 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] [instance: 0638842c-99ae-4567-8d38-47dd4d5739ff] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:52:15.497368 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:15.497904 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:15.510279 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] [instance: 0638842c-99ae-4567-8d38-47dd4d5739ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:52:15.512177 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:15.512681 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:15.565989 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:15.567167 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-66193f4c-cc6d-4e25-9ffb-bdaaba0891cd tempest-ServerAddressesTestJSON-1430779800 tempest-ServerAddressesTestJSON-1430779800-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:18.050455 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:52:18.098506 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:18.098914 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:18.150339 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:18.151346 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:18.152251 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:18.152882 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:18.172231 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Getting quotas for project ec20e18588ad4b698f5df1d7dc0e0c68. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:52:18.177733 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Getting quotas for user 4405f5255af1431a99c1fa794a9f3b41 and project ec20e18588ad4b698f5df1d7dc0e0c68. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:52:18.191386 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] [instance: 64d0b2c3-e514-453d-9e03-cdeea9ca4853] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:52:18.192552 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:18.193021 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:18.226364 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] [instance: 64d0b2c3-e514-453d-9e03-cdeea9ca4853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:52:18.228351 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:18.228867 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:18.268156 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:52:18.268568 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-71cbb8bb-a27a-452a-9f01-878ad98dc17a tempest-LiveMigrationNegativeTest-1357119742 tempest-LiveMigrationNegativeTest-1357119742-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:52:49.947851 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:52:50.974073 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47134. Dec 16 18:53:02.428171 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:53:02.490538 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:02.491043 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:02.611403 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:02.611880 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:02.613560 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:02.614510 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:02.640137 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Getting quotas for project 4f7d8a1c56d940ad96fbb045dcb55234. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:53:02.650492 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Getting quotas for user 4de77aadc6324b5bb56251fc8039ebb0 and project 4f7d8a1c56d940ad96fbb045dcb55234. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:53:02.670986 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] [instance: 64d7cc48-a2d2-4880-8b6f-0ff5959b5128] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:53:02.672099 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:02.672697 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:02.689219 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] [instance: 64d7cc48-a2d2-4880-8b6f-0ff5959b5128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:53:02.692140 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:02.693004 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:02.749446 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:02.750506 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0976a5f6-5511-4db3-ae78-6103eef811fe tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:20.997660 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:53:21.022108 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:21.023004 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:21.106043 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:21.106912 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:21.107978 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:21.108598 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:21.127742 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Getting quotas for project ca4a2b14fe434c7a8b3edbfa8e4e18de. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:53:21.135336 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Getting quotas for user 7fcdca21082d4843928ac1cee3b81b7f and project ca4a2b14fe434c7a8b3edbfa8e4e18de. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:53:21.158692 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] [instance: bbcc6838-4e55-4173-93f6-ffffc56cd9f5] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:53:21.159846 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:21.160431 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:21.169582 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] [instance: bbcc6838-4e55-4173-93f6-ffffc56cd9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:53:21.171711 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:21.172459 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:21.217866 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:21.221116 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ddd2f615-05f1-4bc6-b965-f4b801f739ca tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:22.938217 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:53:23.059954 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:23.063577 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:23.176033 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:23.176967 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:23.178410 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:23.179014 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:23.204592 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:53:23.218972 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for user 8d377db5b0d944168386ab7f23fc38c1 and project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:53:23.263295 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: 7a5942c5-1c29-4a83-b408-c4dfafe67e32] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:53:23.271769 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:23.273461 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:23.298631 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: 7a5942c5-1c29-4a83-b408-c4dfafe67e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:53:23.307366 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:23.310520 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:23.422133 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:23.422568 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-0641b50e-b92c-466f-8afe-8e904ae50d82 tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:26.158118 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:53:26.181712 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:26.182116 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:26.230903 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:26.231300 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:26.232139 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:26.232607 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:26.251764 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Getting quotas for project ca4a2b14fe434c7a8b3edbfa8e4e18de. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:53:26.258294 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Getting quotas for user 7fcdca21082d4843928ac1cee3b81b7f and project ca4a2b14fe434c7a8b3edbfa8e4e18de. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:53:26.272720 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] [instance: ae71f407-b8ba-4f40-a559-82158ded0f7a] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:53:26.273829 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:26.274342 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:26.283218 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] [instance: ae71f407-b8ba-4f40-a559-82158ded0f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:53:26.284586 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:26.285561 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:26.336927 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:26.337339 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-278c7ff0-51c0-440b-a0cf-0d8950dcfd8e tempest-ServerRescueNegativeTestJSON-1314043226 tempest-ServerRescueNegativeTestJSON-1314043226-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:34.016003 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:53:34.058609 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:34.059018 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:34.175228 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:34.175943 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:34.176702 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:34.177079 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:34.206359 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Getting quotas for project 4f7d8a1c56d940ad96fbb045dcb55234. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:53:34.212133 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Getting quotas for user 4de77aadc6324b5bb56251fc8039ebb0 and project 4f7d8a1c56d940ad96fbb045dcb55234. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:53:34.227502 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] [instance: e143dc7a-fc8d-40b0-b41b-f562192fbe48] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:53:34.228925 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:34.229615 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:34.241947 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] [instance: e143dc7a-fc8d-40b0-b41b-f562192fbe48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:53:34.243946 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:34.244595 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:34.368096 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:53:34.368096 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c6decbe3-8210-4520-996c-ac8321780e67 tempest-ServersAdminNegativeTestJSON-1534263941 tempest-ServersAdminNegativeTestJSON-1534263941-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:53:38.509053 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:54:08.848608 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:54:22.290605 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:54:22.403563 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:22.404025 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:22.498097 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:22.498816 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:22.500736 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:22.501399 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:22.524669 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:54:22.532378 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Getting quotas for user 8d377db5b0d944168386ab7f23fc38c1 and project 7fbdf33d67b543898b66015793f839cc. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:54:22.547080 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: f9743e75-445e-452a-9dae-0913039827b9] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:54:22.548403 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:22.548987 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:22.565496 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] [instance: f9743e75-445e-452a-9dae-0913039827b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:54:22.574845 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:22.576816 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:22.648373 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:22.648884 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0cb69a4b-c324-4d91-994a-78ac41eac2bd tempest-ImagesTestJSON-503066073 tempest-ImagesTestJSON-503066073-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:32.833745 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:54:32.886764 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:32.887180 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:33.015889 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:33.020274 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:33.021416 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:33.036731 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:33.131425 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:54:33.143490 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for user fb2a0d90b366469b9c9d645741986b8f and project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:54:33.206462 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: e659ad4e-6972-480f-ac29-24ee34f66c7a] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:54:33.207425 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:33.212858 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:33.249501 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: e659ad4e-6972-480f-ac29-24ee34f66c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:54:33.250814 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:33.251260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:33.386636 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:33.387573 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-745f3945-1da2-47c5-acb1-89b033200faa tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:36.959111 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:54:37.010514 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:37.012705 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:37.092428 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:37.093470 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:37.094478 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:37.095366 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:37.118746 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:54:37.126514 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for user f80e91616ca64d23ba6d748f97f9a329 and project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:54:37.163831 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 0136f398-8b70-426f-8126-371b3fd6aad4] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:54:37.166483 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:37.167347 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:37.182518 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 0136f398-8b70-426f-8126-371b3fd6aad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:54:37.185183 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:37.185968 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:37.265406 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:37.266052 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8021481b-af7f-4d92-bc1d-a0b78c3687ce tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:12.593091 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:12.594201 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:12.727916 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:55:12.728761 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:12.729477 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.138123 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Created allocations for migration 3a8018ed-2157-49df-a55a-f59d1ac370c9 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:55:14.346326 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Took 1.57 seconds to select destinations for 2 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:14.421151 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.426092 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.536111 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.537828 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.669815 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.670232 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.671189 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.671588 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.695727 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:14.701853 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for user fb2a0d90b366469b9c9d645741986b8f and project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:14.720377 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 08bfceca-bd77-4fb6-b140-ee2e8da299a3] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:14.721733 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.722198 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.734400 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 08bfceca-bd77-4fb6-b140-ee2e8da299a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:14.736737 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.737385 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.737655 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 0136f398-8b70-426f-8126-371b3fd6aad4] Instance allocations successfully created on destination node f3e8aa33-a634-4f3a-8683-94d69edc9cc6: {'allocations': {'f3e8aa33-a634-4f3a-8683-94d69edc9cc6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89821) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:55:14.739115 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'resources' on Instance uuid 0136f398-8b70-426f-8126-371b3fd6aad4 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:55:14.747646 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'pci_requests' on Instance uuid 0136f398-8b70-426f-8126-371b3fd6aad4 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:55:14.818764 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.820042 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:14.887057 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 5b32780a-8dc1-4977-8925-115bfbb8ba4b] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:14.888997 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance_group [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lazy-loading 'hosts' on InstanceGroup uuid 999ce6a0-9a60-48eb-b425-dad3401045e5 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Dec 16 18:55:14.990401 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:14.994337 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:15.025120 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 5b32780a-8dc1-4977-8925-115bfbb8ba4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:15.028266 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:15.036504 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:15.130024 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:15.130973 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-45f1ca82-e610-46f9-95e6-248ace68e5a7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:15.308025 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.live_migrate [None req-401d0e4b-48ea-4916-9b33-96a1f3105c82 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 0136f398-8b70-426f-8126-371b3fd6aad4] Start binding ports on destination host: n-h1-821350-1 {{(pid=89821) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:55:20.955550 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:21.059723 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:21.060137 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:21.141214 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:21.141617 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:21.142454 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:21.142880 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:21.161782 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Getting quotas for project 4a8eecf2e07b4822b7c40f8dc2c8adcf. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:21.167038 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Getting quotas for user 34ed0a3aa07044b4954b4865d0537fc3 and project 4a8eecf2e07b4822b7c40f8dc2c8adcf. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:21.181885 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] [instance: 1e6666fb-8f44-402d-9743-9893ab7a3daa] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:21.183586 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:21.184197 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:21.194092 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] [instance: 1e6666fb-8f44-402d-9743-9893ab7a3daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:21.197142 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:21.197903 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:21.243394 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:21.244518 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7bbe95f6-31a4-4831-bf4a-dad072263456 tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:23.926520 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:23.969108 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:23.969953 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:24.045673 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:24.046409 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:24.047762 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:24.048363 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:24.083726 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Getting quotas for project 4a8eecf2e07b4822b7c40f8dc2c8adcf. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:24.093228 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Getting quotas for user 34ed0a3aa07044b4954b4865d0537fc3 and project 4a8eecf2e07b4822b7c40f8dc2c8adcf. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:24.116556 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] [instance: 8a3f3697-b680-4864-a1cb-baab9337232c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:24.118345 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:24.119078 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:24.132820 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] [instance: 8a3f3697-b680-4864-a1cb-baab9337232c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:24.136055 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:24.136998 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:24.205761 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:24.207244 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c71845c-40e0-43f8-a9d2-90139ef29cbf tempest-ListImageFiltersTestJSON-1680634031 tempest-ListImageFiltersTestJSON-1680634031-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:30.359823 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:30.412401 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:30.413540 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:30.517314 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:30.517722 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:30.518787 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:30.519738 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:30.548360 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Getting quotas for project 7c7610dab13946cfb43da68e1ab3073d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:30.557960 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Getting quotas for user 296d59cadfd14394a5c41c482acb5194 and project 7c7610dab13946cfb43da68e1ab3073d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:30.573691 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] [instance: da10a584-1df9-48ff-b9c6-e34eb804e08c] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:30.575090 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:30.575560 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:30.588325 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] [instance: da10a584-1df9-48ff-b9c6-e34eb804e08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:30.590668 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:30.591401 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:30.652496 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:30.652496 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a8a5b348-90c0-4ded-ae7f-fc9e9e164a7f tempest-ImagesNegativeTestJSON-1883181762 tempest-ImagesNegativeTestJSON-1883181762-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:34.870842 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Took 0.92 seconds to select destinations for 3 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:34.901638 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:34.902050 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.010996 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.011727 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.070360 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.071087 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.149154 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.150899 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.152472 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.153317 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.189732 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Getting quotas for project 097197d562df451089d6b0a24f2ef199. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:35.199660 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Getting quotas for user d5f174020a4e422d973428dc53137523 and project 097197d562df451089d6b0a24f2ef199. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:35.224041 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] [instance: c5581c26-1955-4f38-a604-e1a0c11c343e] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:35.227436 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.229293 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.241877 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] [instance: c5581c26-1955-4f38-a604-e1a0c11c343e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:35.244113 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.244974 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.308919 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.310512 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.334613 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] [instance: 5cd2aa85-456b-4803-baba-d93b21d643d5] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:35.336602 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.337322 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.351271 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] [instance: 5cd2aa85-456b-4803-baba-d93b21d643d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:35.354639 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.356144 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.453900 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.454994 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.477631 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] [instance: 7c955d18-1866-4ef3-a3e7-1e1ea6448858] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:35.481037 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.482640 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.514649 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] [instance: 7c955d18-1866-4ef3-a3e7-1e1ea6448858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:35.517068 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.517849 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:35.615210 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:35.615884 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-471b70c8-bf9f-4185-8c86-6db9e4dc6d4e tempest-ListServersNegativeTestJSON-1477710856 tempest-ListServersNegativeTestJSON-1477710856-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:00.245356 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:00.281282 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:00.282201 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:00.420684 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:00.421231 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:00.422314 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:00.422922 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:00.477944 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:00.485233 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for user f80e91616ca64d23ba6d748f97f9a329 and project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:00.501695 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 2788669d-4eea-47ce-95c3-b2e7017a53a1] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:00.503604 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:00.504122 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:00.514194 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 2788669d-4eea-47ce-95c3-b2e7017a53a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:00.515877 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:00.516550 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:00.599977 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:00.600622 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-50006b84-b42f-47ca-95c6-e781ba8624c5 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:09.331982 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:09.333872 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.320902 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Took 0.83 seconds to select destinations for 2 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:10.380127 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.381160 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.605686 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.606120 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.708144 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.708624 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.709273 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.709676 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.754680 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:10.769995 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for user fb2a0d90b366469b9c9d645741986b8f and project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:10.793806 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: faefcc5b-5708-466c-b56f-7916b65c4203] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:10.800963 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.801376 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.813650 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: faefcc5b-5708-466c-b56f-7916b65c4203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:10.815791 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.816242 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.869186 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.869873 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.883242 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 4216cc1d-ae03-4992-9f9e-92e627be37e4] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:10.884362 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance_group [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lazy-loading 'hosts' on InstanceGroup uuid 6f11aa10-73d2-4aae-b1b4-86c085163595 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Dec 16 18:56:10.906258 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.907052 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:10.925661 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 4216cc1d-ae03-4992-9f9e-92e627be37e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:10.927742 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:10.929159 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:11.029448 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:11.037199 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-86cfd7be-3f76-4f76-8742-e5262b72b91f tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:15.613218 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:15.639170 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:16.461484 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:16.570950 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:16.571356 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:16.743659 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:16.744332 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:16.746980 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:16.752969 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:16.864454 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Getting quotas for project 6dc3c90d2ca14852bbc0b2d566115dab. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:16.879390 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Getting quotas for user b14a1dcff8f04b1fbccbba57ae9a81c5 and project 6dc3c90d2ca14852bbc0b2d566115dab. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:16.907295 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] [instance: 1721cd3c-f2ac-4ba2-9ce3-97d29e437ad8] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:16.909166 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:16.916563 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:16.927235 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] [instance: 1721cd3c-f2ac-4ba2-9ce3-97d29e437ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:16.929060 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:16.929953 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:16.992629 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:16.993473 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-cdf4dab9-5996-4794-9152-9ee6bb9039b7 tempest-ServerGroupTestJSON-826922368 tempest-ServerGroupTestJSON-826922368-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:35.999714 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:36.068805 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.069234 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:36.179000 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.179664 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:36.180629 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.181207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:36.204582 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Getting quotas for project 18b7a475fa384e84b31b4c0e07cca6b6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:36.212527 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Getting quotas for user 73d842762b444d6d9695f69c006ac303 and project 18b7a475fa384e84b31b4c0e07cca6b6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:36.229538 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] [instance: 66eed1d0-43e8-4668-9129-5efbd7e5e689] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:36.231102 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.231717 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:36.242918 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] [instance: 66eed1d0-43e8-4668-9129-5efbd7e5e689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:36.245738 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.246919 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:36.316711 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.317505 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-60f386df-c651-4208-ab4b-dc43ca456c88 tempest-ImagesOneServerTestJSON-1131329605 tempest-ImagesOneServerTestJSON-1131329605-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:40.472545 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:56:40.473370 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:40.475154 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:41.422320 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Created allocations for migration e4e0381c-1d35-41fe-9c63-fd4c21902d4f on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:56:41.669505 n-d-821350-1 nova-conductor[89822]: DEBUG nova.scheduler.utils [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 2788669d-4eea-47ce-95c3-b2e7017a53a1] Instance allocations successfully created on destination node f3e8aa33-a634-4f3a-8683-94d69edc9cc6: {'allocations': {'f3e8aa33-a634-4f3a-8683-94d69edc9cc6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89822) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:56:41.671093 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'resources' on Instance uuid 2788669d-4eea-47ce-95c3-b2e7017a53a1 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:56:41.695723 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'pci_requests' on Instance uuid 2788669d-4eea-47ce-95c3-b2e7017a53a1 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:56:42.125351 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.live_migrate [None req-628bb411-8b8d-4a16-9161-f5ca44abebc0 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 2788669d-4eea-47ce-95c3-b2e7017a53a1] Start binding ports on destination host: n-h1-821350-1 {{(pid=89822) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:56:55.158383 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:55.201434 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:55.202614 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:55.316180 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:55.317532 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:55.319279 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:55.321278 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:55.377814 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:55.395830 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for user fb2a0d90b366469b9c9d645741986b8f and project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:55.442336 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: d8d1cd1e-aaa7-4c39-8a21-6b9844c20ab4] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:55.445612 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:55.448220 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:55.476731 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: d8d1cd1e-aaa7-4c39-8a21-6b9844c20ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:55.481195 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:55.482781 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:55.552403 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:55.553524 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-545de9e5-5023-4b0b-88c1-06e96286436a tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:58.553258 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:57:12.780169 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:12.902746 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:12.903110 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:13.138810 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:13.144400 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:13.152626 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:13.155113 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:13.232604 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:13.249781 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for user f80e91616ca64d23ba6d748f97f9a329 and project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:13.270699 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 1426f080-1c9c-456f-8499-29557e623083] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:13.273355 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:13.274599 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:13.309358 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 1426f080-1c9c-456f-8499-29557e623083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:13.315330 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:13.316899 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:13.419489 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:13.421882 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-c4bb13e5-2d4d-44f9-a0aa-6be4e5067cb4 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:28.602074 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.81 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:28.637720 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:28.638623 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:28.784725 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:28.785824 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:28.787034 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:28.789699 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:28.841499 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:28.847858 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:28.871711 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: fcdd69d5-68d1-4147-a7ad-1fc94578e92b] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:28.873801 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:28.876486 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:28.888069 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:57:28.943512 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: fcdd69d5-68d1-4147-a7ad-1fc94578e92b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:28.951669 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:28.952084 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.071034 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.071705 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-b4d8ff44-1d5a-43ff-a6f2-0bc006aa55cb tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.293867 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:29.379295 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.383022 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.566442 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.566869 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.570083 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.572679 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.659048 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Getting quotas for project eb152896b8cb4e97979a17ddf37f6b72. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:29.670243 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Getting quotas for user 74b3604e7cb54e92a80f432ecdfbf288 and project eb152896b8cb4e97979a17ddf37f6b72. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:29.720379 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] [instance: d952b2ca-23d8-4ca3-9369-7103deada513] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:29.722004 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.722731 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.743387 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] [instance: d952b2ca-23d8-4ca3-9369-7103deada513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:29.745683 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.748503 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:29.857701 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:29.858326 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-1c1463b2-54d4-446a-9637-8a2d97a31021 tempest-ServerTagsTestJSON-1516608770 tempest-ServerTagsTestJSON-1516608770-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:31.938805 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:32.010498 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:32.016762 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:32.168955 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:32.169815 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:32.173344 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:32.173916 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:32.204675 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:32.210813 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for user fb2a0d90b366469b9c9d645741986b8f and project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:32.226628 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 3fa2aea6-7d5c-43ea-9f96-7d6c6daa062f] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:32.227891 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:32.228447 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:32.240790 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: 3fa2aea6-7d5c-43ea-9f96-7d6c6daa062f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:32.244630 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:32.246438 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:32.347436 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:32.347829 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-32c0c3ee-1194-4fb0-9c06-d529454930c7 tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:36.754568 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:36.830242 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:36.835449 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:37.028546 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:37.030945 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:37.041215 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:37.042622 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:37.154016 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Getting quotas for project 77cd28f8f32e435295fbb505f01ce3aa. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:37.167598 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Getting quotas for user 3ea92c56700741cf82f9ff4479b0be5d and project 77cd28f8f32e435295fbb505f01ce3aa. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:37.190436 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] [instance: 07dcbef5-7b86-485e-81ad-b4a4b711145f] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:37.193388 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:37.194772 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:37.212477 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] [instance: 07dcbef5-7b86-485e-81ad-b4a4b711145f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:37.216223 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:37.217608 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:37.314755 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:37.315922 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f8aedf14-1aa4-4dce-b666-1668ab8638fe tempest-ServerAddressesNegativeTestJSON-883766304 tempest-ServerAddressesNegativeTestJSON-883766304-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:50.966291 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:57:52.024087 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51904. Dec 16 18:58:04.268870 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:04.334639 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:04.339487 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:04.434720 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:04.436441 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:04.438758 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:04.441687 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:04.505122 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:04.519358 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Getting quotas for user fb2a0d90b366469b9c9d645741986b8f and project 92a32778a494421bbcdf97e592b467d0. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:04.548974 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: be65d4cc-adea-4325-9e5b-8bab0088acc9] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:04.551763 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:04.557421 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:04.568186 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] [instance: be65d4cc-adea-4325-9e5b-8bab0088acc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:04.569972 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:04.570412 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:04.617578 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:04.618553 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-cb11bfd9-cc05-4134-9c76-bb9598a8782c tempest-ServersOnMultiNodesTest-324026960 tempest-ServersOnMultiNodesTest-324026960-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:08.299260 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:08.350000 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:08.350948 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:08.476810 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:08.477468 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:08.478779 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:08.479336 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:08.500146 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:08.506549 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:08.539379 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: f36cec36-6de5-4c93-be23-5455eb1a9008] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:08.540450 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:08.540965 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:08.552456 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: f36cec36-6de5-4c93-be23-5455eb1a9008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:08.558862 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:08.560473 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:08.613536 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:08.614182 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a44f2dc2-7609-405e-b215-03b361e85a72 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:10.502073 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:58:10.503670 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:10.504386 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:11.205204 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Created allocations for migration 59688fb3-221c-419f-84d0-b28f75401ec8 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:58:11.414845 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 1426f080-1c9c-456f-8499-29557e623083] Instance allocations successfully created on destination node f3e8aa33-a634-4f3a-8683-94d69edc9cc6: {'allocations': {'f3e8aa33-a634-4f3a-8683-94d69edc9cc6': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89821) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:58:11.415424 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'resources' on Instance uuid 1426f080-1c9c-456f-8499-29557e623083 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:58:11.420629 n-d-821350-1 nova-conductor[89821]: DEBUG nova.objects.instance [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'pci_requests' on Instance uuid 1426f080-1c9c-456f-8499-29557e623083 {{(pid=89821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:58:12.079179 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.live_migrate [None req-31877434-6ec1-447c-a293-d5a8d0270af5 tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 1426f080-1c9c-456f-8499-29557e623083] Start binding ports on destination host: n-h1-821350-1 {{(pid=89821) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:58:17.189427 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:17.250678 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:17.251329 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:17.347692 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:17.348591 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:17.351794 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:17.352688 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:17.396209 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:17.405455 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:17.427386 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: ab944840-af35-407d-acae-b10cb41b38c1] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:17.430505 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:17.431562 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:17.457582 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: ab944840-af35-407d-acae-b10cb41b38c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:17.464373 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:17.465371 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:17.656989 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:17.657743 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a873e18c-49f9-4edd-b062-5d918ba50287 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.262334 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:32.320932 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.322014 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.443709 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.445601 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.446887 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.447688 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.492187 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Getting quotas for project 72e81ca7ffef447fbc1ade94c7a81f85. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:32.513722 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Getting quotas for user dc962ea1f5994016a60598d0601d8519 and project 72e81ca7ffef447fbc1ade94c7a81f85. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:32.547189 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] [instance: f46f0c81-c361-4968-93f2-e67913c90b53] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:32.555695 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.556370 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.574684 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] [instance: f46f0c81-c361-4968-93f2-e67913c90b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:32.576201 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.576859 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.647124 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.648063 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-6098ea39-4475-4f3a-903b-72bf101dff40 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:45.307361 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d5c534b9-2e7a-49cd-ba99-cc01540860b6 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:58:45.308177 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d5c534b9-2e7a-49cd-ba99-cc01540860b6 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:45.309943 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d5c534b9-2e7a-49cd-ba99-cc01540860b6 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:45.373720 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d5c534b9-2e7a-49cd-ba99-cc01540860b6 tempest-ServerShowV257Test-1497341810 tempest-ServerShowV257Test-1497341810-project] [instance: f46f0c81-c361-4968-93f2-e67913c90b53] No migration record for the rebuild/evacuate request. {{(pid=89822) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:59:08.795011 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:59:08.885263 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:08.886776 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:09.101242 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:09.107164 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:09.109921 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:09.117038 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:09.206208 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:59:09.231381 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:59:09.277918 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: ea9d62e2-97b4-42fb-83e6-f8ec8c2c25c4] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:59:09.286517 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:09.287715 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:09.314618 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: ea9d62e2-97b4-42fb-83e6-f8ec8c2c25c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:59:09.319721 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:09.323698 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:09.469034 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:09.469788 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ad880c56-df20-4faf-a0c7-5ab63db778d3 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:41.754441 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:59:42.778316 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53886. Dec 16 18:59:54.900936 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:59:55.015094 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:55.015739 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:55.150524 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:55.150914 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:55.151865 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:55.159951 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:55.193699 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:59:55.207568 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Getting quotas for user f80e91616ca64d23ba6d748f97f9a329 and project 58a011186671483e9ea77683379a165f. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:59:55.239149 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 046515f0-3691-439a-8344-1f6b4aec0320] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:59:55.240114 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:55.243004 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:55.261572 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] [instance: 046515f0-3691-439a-8344-1f6b4aec0320] block_device_mapping [BlockDeviceMapping(attachment_id=46172d78-6764-4929-985e-c846fbdf3fec,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='602d8077-7c21-44ee-9035-192906ec7e8e',volume_size=1,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:59:55.264331 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:55.265017 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:55.317221 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:55.317772 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68c26db5-2dbb-46dd-ac74-937b0ba50683 tempest-LiveAutoBlockMigrationV225Test-1126207767 tempest-LiveAutoBlockMigrationV225Test-1126207767-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:03.116748 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:03.168610 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:03.170307 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:03.363927 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:03.364420 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:03.365258 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:03.365716 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:03.411941 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Getting quotas for project 4e913c105a704838a5b0efa954964ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:03.424016 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Getting quotas for user 48a51778b9ad4d97ae2d553c3b2bf93d and project 4e913c105a704838a5b0efa954964ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:03.455228 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] [instance: d81e7a73-9c22-42f9-9742-4fc6035fda9a] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:03.460035 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:03.460702 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:03.477356 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] [instance: d81e7a73-9c22-42f9-9742-4fc6035fda9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:03.479141 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:03.479752 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:03.540186 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:03.541306 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d036094d-258b-4484-a9a7-69032458fc9e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:05.214281 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:05.358988 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:05.365575 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:05.560213 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:05.561077 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:05.562957 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:05.563554 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:05.674429 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:05.689297 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:05.746392 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: d4a2909d-61cf-4d24-87f1-748d184075a4] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:05.748326 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:05.751083 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:05.771218 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: d4a2909d-61cf-4d24-87f1-748d184075a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:05.772665 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:05.773109 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:05.843840 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:05.844250 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7d6ca478-1043-49fe-8c11-66320202a844 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:32.214022 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Took 1.65 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:32.257743 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:32.258062 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:32.412945 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:32.422631 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:32.424254 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:32.425060 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:32.484808 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Getting quotas for project b1d794eaedb34b90bdf4436fc1d9b71a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:32.495372 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Getting quotas for user e4fbd4b15b544324b8b9c3cd8da76285 and project b1d794eaedb34b90bdf4436fc1d9b71a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:32.521714 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] [instance: 90d3784c-693e-4626-94d9-58b0f399399c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:32.524539 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:32.525857 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:32.541152 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] [instance: 90d3784c-693e-4626-94d9-58b0f399399c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:32.545769 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:32.546926 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:32.604280 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:32.604724 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-995eb963-7d9e-400b-93ea-e25aa3f2f576 tempest-TenantUsagesTestJSON-1937838125 tempest-TenantUsagesTestJSON-1937838125-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:42.847760 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:00:42.848428 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:42.852137 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:43.506722 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Created allocations for migration 53fc220f-be1a-4098-a95f-071c01a98c5c on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:00:43.797834 n-d-821350-1 nova-conductor[89822]: DEBUG nova.scheduler.utils [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 046515f0-3691-439a-8344-1f6b4aec0320] Instance allocations successfully created on destination node 2ec5f0ed-a520-4003-9f1a-57c72c316219: {'allocations': {'2ec5f0ed-a520-4003-9f1a-57c72c316219': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89822) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 19:00:43.798562 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'resources' on Instance uuid 046515f0-3691-439a-8344-1f6b4aec0320 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:00:43.809166 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] Lazy-loading 'pci_requests' on Instance uuid 046515f0-3691-439a-8344-1f6b4aec0320 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:00:44.301977 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.live_migrate [None req-701d0b55-bf98-4976-b0df-384c9c3cfabf tempest-LiveAutoBlockMigrationV225Test-2010642905 tempest-LiveAutoBlockMigrationV225Test-2010642905-project-admin] [instance: 046515f0-3691-439a-8344-1f6b4aec0320] Start binding ports on destination host: n-h2-821350-1 {{(pid=89822) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 19:00:46.956344 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:46.983991 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:46.984386 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:47.044821 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:47.045524 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:47.046571 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:47.047672 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:47.071158 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:47.077347 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:47.094099 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: 46f8c77d-872e-40f7-af25-b41dba1a83b6] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:47.095704 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:47.096648 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:47.108039 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: 46f8c77d-872e-40f7-af25-b41dba1a83b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:47.110249 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:47.111172 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:47.156922 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:47.157567 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-195a342b-787f-4a22-ac67-24d8aa55b0bc tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:49.008244 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:00:52.023483 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:00:53.063631 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 55310. Dec 16 19:01:50.353370 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:50.520115 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:50.522958 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:50.677460 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:50.678636 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:50.680678 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:50.685384 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:50.734728 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:50.741561 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:50.777582 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: a83330ec-35ae-4b31-9777-3dbd98c5acf2] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:50.778741 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:50.779149 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:50.794100 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: a83330ec-35ae-4b31-9777-3dbd98c5acf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:50.795931 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:50.796366 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:50.875236 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:50.875780 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-69f08ce0-7347-44fd-b7b7-03954493b755 tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:55.165798 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:55.301200 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:55.302207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:55.529903 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:55.530423 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:55.540458 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:55.540954 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:55.596067 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Getting quotas for project d54343ffd00b40238ee12b82feb6f638. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:55.607838 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Getting quotas for user c18edbd6bf944171b813e7634afc3c15 and project d54343ffd00b40238ee12b82feb6f638. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:55.640308 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] [instance: 8793c287-75e6-4a17-b753-e0416fc9d9ad] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:55.641768 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:55.642524 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:55.654320 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] [instance: 8793c287-75e6-4a17-b753-e0416fc9d9ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:55.657079 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:55.657921 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:55.747494 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:55.748417 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a4ed3807-2eb3-4428-b8f0-ecbd33a8d4dc tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.597906 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:02:08.210671 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:02:08.283522 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:08.283938 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:08.460316 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:08.466535 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:08.472186 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:08.473843 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:08.543645 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Getting quotas for project cf48a15c06674d1d9ddbd8c6270fc502. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:02:08.556443 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Getting quotas for user 343f67cdc18049639fc4690ce7f1dc1d and project cf48a15c06674d1d9ddbd8c6270fc502. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:02:08.582188 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] [instance: 0deca1a2-9d59-4a35-9805-3bd1e5902814] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:02:08.583875 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:08.584570 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:08.613425 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] [instance: 0deca1a2-9d59-4a35-9805-3bd1e5902814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:02:08.616210 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:08.617227 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:08.706398 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:08.707714 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-f2965c48-9b97-4175-9bd9-0782cdf122c1 tempest-ServersTestManualDisk-1295024671 tempest-ServersTestManualDisk-1295024671-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:36.458533 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:02:36.516150 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:36.516474 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:36.599211 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:36.599858 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:36.601013 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:36.601641 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:36.624891 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:02:36.631467 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Getting quotas for user 7631f2e7f7384447aecd2e294dc4d8a1 and project e8787c659d4c491f8b92db82cd16b860. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:02:36.645416 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: 54c81278-73bd-46c7-a02d-e69cd10aa24c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:02:36.646705 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:36.647260 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:36.657485 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] [instance: 54c81278-73bd-46c7-a02d-e69cd10aa24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:02:36.662990 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:36.663605 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:36.716235 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:36.716958 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-df5e4991-81fa-4b9e-99ee-2977771de95c tempest-ServersTestJSON-1246442361 tempest-ServersTestJSON-1246442361-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:07.376975 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:03:07.436942 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:07.437534 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:07.534750 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:07.535261 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:07.536837 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:07.537432 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:07.559843 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Getting quotas for project d54343ffd00b40238ee12b82feb6f638. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:03:07.573413 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Getting quotas for user c18edbd6bf944171b813e7634afc3c15 and project d54343ffd00b40238ee12b82feb6f638. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:03:07.629388 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] [instance: 8732fd65-17f6-488c-8966-65dc59b4a1d6] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:03:07.630510 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:07.639091 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:07.654479 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] [instance: 8732fd65-17f6-488c-8966-65dc59b4a1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:03:07.656234 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:07.656953 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:07.703805 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:07.704379 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e3f06f31-40e5-40a4-be29-842d416cf2a1 tempest-SecurityGroupsTestJSON-508943425 tempest-SecurityGroupsTestJSON-508943425-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:14.794418 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:03:14.835789 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:14.837110 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:14.906198 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:14.906610 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:14.907361 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:14.907792 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:14.930181 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Getting quotas for project cb34c1b5cca1466788204104ac7a549a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:03:14.938660 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Getting quotas for user dec5ee8c98824fda9cf20c07da07b078 and project cb34c1b5cca1466788204104ac7a549a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:03:14.953418 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] [instance: 161f6ef1-27f2-4ea6-8308-5c64ffa9c88c] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:03:14.954798 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:14.961848 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:14.972089 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] [instance: 161f6ef1-27f2-4ea6-8308-5c64ffa9c88c] block_device_mapping [BlockDeviceMapping(attachment_id=439aa7e8-e3e2-46eb-a9a5-bea20dbf504a,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='9f6d2e07-eb87-4c03-81d6-745541ea31bd',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=a66daaaa-a63f-44d5-a250-557e81ab676c,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6cb2b840-5258-4ea8-a223-86bb5fa9c4d4',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=9e839d84-bb97-4023-90b2-e21efa9a6e14,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7281655b-e91f-4abe-876e-e5effea75b0f',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:03:14.974757 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:14.975234 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:14.989895 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:14.990439 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.009101 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.010515 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.105250 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.105917 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9f56720b-16f6-48ec-b88d-aaf79516f307 tempest-TaggedBootDevicesTest_v242-2007087646 tempest-TaggedBootDevicesTest_v242-2007087646-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:42.778661 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:03:43.810268 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 58320. Dec 16 19:03:53.073272 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:03:54.104697 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 58416. Dec 16 19:03:54.387553 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Took 1.06 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:03:54.526835 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:54.527425 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:54.712187 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:54.714740 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:54.717149 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:54.720771 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:54.795053 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Getting quotas for project c854e7aa678640dfba93a2034873d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:03:54.812254 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Getting quotas for user c6e491afd10b4f8abc2f127995ccb824 and project c854e7aa678640dfba93a2034873d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:03:54.843600 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] [instance: 562c2cbd-e36b-495a-a9e7-1594bb94e293] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:03:54.845009 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:54.845667 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:54.877949 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] [instance: 562c2cbd-e36b-495a-a9e7-1594bb94e293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:03:54.881245 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:54.881983 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:54.989453 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:54.990372 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-320fd832-e293-41a1-b274-be3e7904ab0c tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:09.079650 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:04:33.647106 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3ede3f87-91c4-4ad7-a07c-252e875a9009 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method unshelve_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:04:33.651043 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3ede3f87-91c4-4ad7-a07c-252e875a9009 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:33.656511 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3ede3f87-91c4-4ad7-a07c-252e875a9009 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.471923 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:04:34.497513 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.497914 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.575291 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.575537 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.576807 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.577454 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.601228 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Getting quotas for project c854e7aa678640dfba93a2034873d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:04:34.606808 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Getting quotas for user c6e491afd10b4f8abc2f127995ccb824 and project c854e7aa678640dfba93a2034873d32e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:04:34.627565 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] [instance: a18e68f8-0ebf-466d-8f1f-ca7aaa3a575a] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:04:34.629599 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.630431 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.656168 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] [instance: a18e68f8-0ebf-466d-8f1f-ca7aaa3a575a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:04:34.658004 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.659009 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.709760 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.710867 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-aa81ecb9-ad3c-4d0b-ae3c-c1d4b62f52ac tempest-FloatingIPsAssociationTestJSON-708924373 tempest-FloatingIPsAssociationTestJSON-708924373-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.907809 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3ede3f87-91c4-4ad7-a07c-252e875a9009 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] [instance: d81e7a73-9c22-42f9-9742-4fc6035fda9a] Requesting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) during scheduling {{(pid=89821) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 19:04:35.674114 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3ede3f87-91c4-4ad7-a07c-252e875a9009 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:04:46.337050 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:04:46.403085 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:46.403511 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:46.486777 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:46.487243 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:46.488001 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:46.488779 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:46.543265 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Getting quotas for project cc06aae2d93747339022046a33c11085. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:04:46.567302 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Getting quotas for user b2d61d089cef405fbd81f57b5a4f76bb and project cc06aae2d93747339022046a33c11085. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:04:46.613961 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] [instance: 96496ae1-5cca-44db-8e8f-8cf950636ef5] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:04:46.619932 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:46.621642 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:46.650408 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] [instance: 96496ae1-5cca-44db-8e8f-8cf950636ef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:04:46.653359 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:46.654444 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:46.759725 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:46.760764 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8597973d-14fa-4aa3-b2bc-46e3d3264f43 tempest-ServersNegativeTestMultiTenantJSON-1982037018 tempest-ServersNegativeTestMultiTenantJSON-1982037018-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.547893 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Took 0.49 seconds to select destinations for 2 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:05:08.578260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.578985 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.695694 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.696473 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.755008 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.756106 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.757133 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.757726 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.777843 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Getting quotas for project 0775df53ed984ed997ee93ebfba9553b. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:05:08.784871 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Getting quotas for user 04d7a6eabe374c29a81ad9aa8efcefdf and project 0775df53ed984ed997ee93ebfba9553b. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:05:08.808183 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: ce15fe1a-6400-4db1-b869-6e801a2dbc3f] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:08.809566 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.810200 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.823363 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: ce15fe1a-6400-4db1-b869-6e801a2dbc3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:08.825541 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.826192 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.872976 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.873985 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.887133 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: 46fdf125-7747-4afd-bbd2-9dbcef171f1a] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:08.889208 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.889619 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.907913 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: 46fdf125-7747-4afd-bbd2-9dbcef171f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:08.913375 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.913847 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:08.976232 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:08.977166 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e832b990-07dd-436f-a4a7-d37b6f568404 tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:18.694824 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:05:23.993129 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:05:24.053798 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:24.055191 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:24.196177 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:24.198544 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:24.211918 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:24.213306 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:24.318137 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Getting quotas for project cc8f859128d142189e91600a4cc05352. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:05:24.340497 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Getting quotas for user c46f26088cc5431d86231f8447a0e184 and project cc8f859128d142189e91600a4cc05352. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:05:24.391562 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] [instance: a1847fc8-ec5f-4776-89a4-787242cbeab5] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:24.394735 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:24.396628 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:24.421037 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] [instance: a1847fc8-ec5f-4776-89a4-787242cbeab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:24.427542 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:24.429505 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:24.522876 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:24.524004 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-96db8e27-8453-4445-9018-7289452f507f tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.157405 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Took 1.62 seconds to select destinations for 2 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:05:48.266227 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.266227 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.445229 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.445229 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.586237 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.586237 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.586237 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.586237 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.651747 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Getting quotas for project 0775df53ed984ed997ee93ebfba9553b. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:05:48.668668 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Getting quotas for user 04d7a6eabe374c29a81ad9aa8efcefdf and project 0775df53ed984ed997ee93ebfba9553b. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:05:48.704185 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: 8defb355-5e98-4fbf-97eb-dd1a6b17f9a9] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:48.704185 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.704185 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.730533 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: 8defb355-5e98-4fbf-97eb-dd1a6b17f9a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:48.730533 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.730533 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.825430 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.825430 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.843932 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: 40867fce-1e4c-4218-ae9a-37aee14e1d94] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:48.843932 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.843932 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.881907 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] [instance: 40867fce-1e4c-4218-ae9a-37aee14e1d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:48.881907 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.881907 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:48.959681 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:48.959681 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-664c5bd2-ea43-4699-a995-81c21d49bdef tempest-MultipleCreateTestJSON-2138367157 tempest-MultipleCreateTestJSON-2138367157-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:15.298114 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:06:15.354065 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:15.355263 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:15.465177 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:15.466684 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:15.469314 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:15.470677 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:15.528882 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Getting quotas for project cc8f859128d142189e91600a4cc05352. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:06:15.534273 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Getting quotas for user c46f26088cc5431d86231f8447a0e184 and project cc8f859128d142189e91600a4cc05352. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:06:15.548617 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] [instance: ae7ccace-be79-4dd5-a67c-e1e4342db4c7] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:15.551457 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:15.552038 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:15.564352 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] [instance: ae7ccace-be79-4dd5-a67c-e1e4342db4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:15.567066 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:15.568187 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:15.624887 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:15.625203 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-02b13d69-bf0f-4053-a63a-0af83b79f310 tempest-VolumesActionsTest-1453349566 tempest-VolumesActionsTest-1453349566-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:43.813185 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:06:44.843085 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 60560. Dec 16 19:06:50.593619 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:06:50.682610 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:50.685321 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:50.765095 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:50.765792 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:50.766792 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:50.767369 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:50.790055 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Getting quotas for project 4e913c105a704838a5b0efa954964ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:06:50.797359 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Getting quotas for user 48a51778b9ad4d97ae2d553c3b2bf93d and project 4e913c105a704838a5b0efa954964ea2. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:06:50.810077 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] [instance: 8e09b223-7fb8-4cd4-a961-91bcdc88715f] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:50.811738 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:50.812303 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:50.823146 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] [instance: 8e09b223-7fb8-4cd4-a961-91bcdc88715f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:50.825138 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:50.825739 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:50.874183 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:50.875111 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a08d854a-eee8-48b3-ac42-3ffb35e0c038 tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:54.107474 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:06:54.275073 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:06:54.387683 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:54.391136 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:54.575486 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:54.576410 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:54.577492 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:54.578205 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:54.600818 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:06:54.611269 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:06:54.629352 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: 044770ed-50e4-4772-b7ad-0f22de331f2d] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:54.630654 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:54.631207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:54.641822 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: 044770ed-50e4-4772-b7ad-0f22de331f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:54.644415 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:54.645050 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:54.723349 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:54.723758 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-794ce865-e560-4517-bfc6-7177be4c8776 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:55.175738 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 60802. Dec 16 19:07:29.113856 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:07:41.866395 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:41.927941 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:41.928726 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:42.054534 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:42.056685 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:42.058545 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:42.060441 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:42.128099 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:42.143278 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:42.159755 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: a58a3e12-c17f-4fc2-a943-0f7446108091] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:42.161270 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:42.162215 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:42.172835 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: a58a3e12-c17f-4fc2-a943-0f7446108091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:42.176323 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:42.176973 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:42.237808 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:42.238756 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7c1c9fa9-4727-4055-901a-577a26f29fd4 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:44.162125 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Took 1.11 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:44.299808 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:44.300521 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:44.470741 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:44.471578 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:44.472959 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:44.473616 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:44.538489 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Getting quotas for project 26574ab26a0d4781a8c3961708f2cd05. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:44.554925 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Getting quotas for user 245bc9c7fdf841b0b842ac02c00be0f6 and project 26574ab26a0d4781a8c3961708f2cd05. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:44.599848 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] [instance: 1b93dc8c-0a55-4924-be4d-e4f55ef44620] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:44.601675 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:44.604957 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:44.629030 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] [instance: 1b93dc8c-0a55-4924-be4d-e4f55ef44620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:44.630859 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:44.631486 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:44.703167 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:44.703562 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8bee881d-cb03-4760-9702-7645ab4b2dfe tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:38.763295 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:08:41.086777 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:41.104059 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: ef328a69-47ae-407b-a630-c94f899e13c9] While scheduling instance, the build request was already deleted. {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1563}} Dec 16 19:08:41.753379 n-d-821350-1 nova-conductor[89822]: INFO nova.scheduler.client.report [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Deleted allocation for instance ef328a69-47ae-407b-a630-c94f899e13c9 Dec 16 19:08:41.765530 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:41.767076 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:41.768224 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:41.768839 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:41.792600 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:41.799531 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-8048f44f-1ac9-48d8-942f-c706a2e4b7d0 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:44.740747 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:44.806576 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:44.811667 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:44.932013 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:44.943757 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:44.944932 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:44.950010 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:44.985638 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Getting quotas for project 26574ab26a0d4781a8c3961708f2cd05. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:45.001220 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Getting quotas for user 245bc9c7fdf841b0b842ac02c00be0f6 and project 26574ab26a0d4781a8c3961708f2cd05. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:45.014773 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] [instance: 38b2d887-75ad-4ed9-a86b-27718ac2b44d] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:08:45.016802 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:45.017431 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:45.034339 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] [instance: 38b2d887-75ad-4ed9-a86b-27718ac2b44d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:08:45.035654 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:45.036207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:45.103124 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:45.103780 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a096912b-d1c6-4f37-b5c9-d06eb0516481 tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:47.284929 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:47.412928 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:47.419961 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:47.539479 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:47.539892 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:47.540629 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:47.541163 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:47.580516 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:47.593278 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:47.634796 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: 702c53bd-f053-4917-9bb3-9f4a7413dfb5] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:08:47.636232 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:47.636815 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:47.656705 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: 702c53bd-f053-4917-9bb3-9f4a7413dfb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:08:47.658724 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:47.659369 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:47.735757 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:47.736219 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-96e28040-6d05-4ffd-b32e-abcd3d1e07f2 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:32.573290 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 0.71 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:09:32.717884 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:32.719037 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:32.892994 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:32.903236 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:32.909199 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:32.911133 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:33.070647 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:09:33.116456 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:09:33.191196 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: ea7f93c3-e8be-47ed-82a1-3fc5c361d2e2] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:09:33.192812 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:33.193693 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:33.232314 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: ea7f93c3-e8be-47ed-82a1-3fc5c361d2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:09:33.239586 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:33.240280 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:33.388437 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:33.390961 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ca18ed4d-ff1b-4c85-880e-2377acc0489c tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:43.165113 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:09:43.289497 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:43.290085 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:43.408454 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:43.410983 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:43.411978 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:43.417753 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:43.492787 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Getting quotas for project 26574ab26a0d4781a8c3961708f2cd05. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:09:43.509373 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Getting quotas for user 245bc9c7fdf841b0b842ac02c00be0f6 and project 26574ab26a0d4781a8c3961708f2cd05. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:09:43.567205 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] [instance: 92808e0f-a16a-43e3-a06d-8f87b7eae3ec] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:09:43.568611 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:43.577542 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:43.592856 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] [instance: 92808e0f-a16a-43e3-a06d-8f87b7eae3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:09:43.594879 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:43.595665 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:43.661100 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:43.661796 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3e8906f5-4872-47d4-ad21-7e1c1724eeaa tempest-ImagesOneServerNegativeTestJSON-663778879 tempest-ImagesOneServerNegativeTestJSON-663778879-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:44.841349 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:09:45.863933 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 36902. Dec 16 19:09:55.180133 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:09:56.224545 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 37050. Dec 16 19:10:10.618566 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2e006f1a-cebe-446f-8acb-0058693f806e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method unshelve_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:10:10.619561 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2e006f1a-cebe-446f-8acb-0058693f806e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:10.619561 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2e006f1a-cebe-446f-8acb-0058693f806e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:11.558347 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2e006f1a-cebe-446f-8acb-0058693f806e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] [instance: 8e09b223-7fb8-4cd4-a961-91bcdc88715f] Requesting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) during scheduling {{(pid=89821) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 19:10:11.971108 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2e006f1a-cebe-446f-8acb-0058693f806e tempest-AttachVolumeShelveTestJSON-1226952957 tempest-AttachVolumeShelveTestJSON-1226952957-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:10:49.169965 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:11:36.494875 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 1.44 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:11:36.612900 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:36.614287 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:36.797954 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:36.798766 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:36.800219 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:36.801090 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:36.844487 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:11:36.854246 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:11:36.877335 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: 0e8beeae-85a8-4877-aaed-3f6a85ca591a] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:11:36.879422 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:36.880069 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:36.894582 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: 0e8beeae-85a8-4877-aaed-3f6a85ca591a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:11:36.899920 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:36.900679 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:36.987601 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:36.988576 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-ebdded12-0ea4-400b-a757-399038adcc0f tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:58.818387 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:12:22.495422 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:12:23.532685 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 38964. Dec 16 19:12:41.208882 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:12:41.262126 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:41.265419 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:41.426730 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:41.427459 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:41.428364 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:41.428895 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:41.454898 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:12:41.460790 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for user cd1e33c2ba5e4f95b7c58bb31cd68875 and project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:12:41.477145 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: 5985e8a0-31f3-4620-a9d7-492f3c44b096] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:12:41.478476 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:41.479073 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:41.490709 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: 5985e8a0-31f3-4620-a9d7-492f3c44b096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:12:41.495217 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:41.513545 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:41.582876 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:41.583368 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-43eea705-63f2-4829-a4f7-5510012a895f tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:45.860966 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:12:46.908237 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39260. Dec 16 19:12:49.701055 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:12:50.733556 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39302. Dec 16 19:12:52.106585 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:12:53.152183 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39326. Dec 16 19:12:53.569741 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Took 1.48 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:12:53.678952 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:53.684458 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:53.830755 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:53.867451 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:53.870316 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:53.873318 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:54.067730 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:12:54.110707 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Getting quotas for user d0d30827c20e44ed83b624e64f5c2a36 and project 7362089e3b77439d986d3b6264515e9a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:12:54.173597 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: be8f3a2a-f0ea-43db-8ed3-13538e6ea4fe] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:12:54.176591 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:54.179318 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:54.203493 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [instance: be8f3a2a-f0ea-43db-8ed3-13538e6ea4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:12:54.206376 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:54.207390 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:54.304353 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:54.305559 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:54.325227 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:12:55.383347 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed74b465-6cc1-45ab-be5a-51cfb18b0734 tempest-DeleteServersTestJSON-326583562 tempest-DeleteServersTestJSON-326583562-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39366. Dec 16 19:12:56.225565 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:12:57.261530 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39386. Dec 16 19:13:27.372182 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:13:27.479015 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:27.480548 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:27.624276 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:27.628559 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:27.631973 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:27.636091 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:27.695218 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:13:27.714730 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for user cd1e33c2ba5e4f95b7c58bb31cd68875 and project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:13:27.762551 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: ccb51672-a71c-4248-8f4c-9fbc9e4656ce] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:13:27.769810 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:27.770628 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:27.794905 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: ccb51672-a71c-4248-8f4c-9fbc9e4656ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:13:27.798890 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:27.801883 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:27.890879 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:27.891361 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8a0b9b6c-9420-4e4b-9260-891dbf93ea02 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.605264 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:13:37.681085 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.681483 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.804224 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.804969 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.805872 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.806464 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.839928 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Getting quotas for project b4449caddd35465ca89113729a97b40c. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:13:37.853955 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Getting quotas for user 8c7ab251e8814b2fa2cd889aca405a96 and project b4449caddd35465ca89113729a97b40c. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:13:37.879542 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] [instance: e296a464-8edc-42ef-b881-510ab30af046] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:13:37.880503 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.884098 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.903881 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] [instance: e296a464-8edc-42ef-b881-510ab30af046] block_device_mapping [BlockDeviceMapping(attachment_id=adf03bac-8099-4cf9-8bcc-388e26ea5ff5,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='865574a9-694d-4952-a6b4-38a6ed8ae0c6',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=4e963080-93cb-426a-9b67-c4e145effe1d,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='49d5e4bc-4fb3-459d-8aad-29f1ff6e0aa1',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=9e2e0e88-e50a-45ce-be39-402a9262161d,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e23efe1-aa2f-4f0b-a457-422992a5e729',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:13:37.906531 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.907564 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.921819 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.922676 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.939118 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.940342 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:37.981142 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:37.982046 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-411e3c44-f51b-48a0-947b-8c8b47c2108d tempest-TaggedBootDevicesTest-1787157056 tempest-TaggedBootDevicesTest-1787157056-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:09.203881 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:14:09.647786 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:14:09.700699 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:09.701496 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:09.814996 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:09.822868 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:09.824055 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:09.827171 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:09.891308 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:14:09.910810 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for user cd1e33c2ba5e4f95b7c58bb31cd68875 and project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:14:09.962015 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: 1b0ffff9-1a80-463f-b406-e7e6c60ef442] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:14:09.966984 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:09.974844 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:09.999045 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: 1b0ffff9-1a80-463f-b406-e7e6c60ef442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:14:10.000387 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:10.000877 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:10.077391 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:10.077838 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d4fe5d45-5766-45fc-8baf-4de86bd46ce4 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:03.786585 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:15:03.857707 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:03.858175 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:03.957290 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:03.958712 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:03.960218 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:03.961147 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:03.994048 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:15:04.010140 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Getting quotas for user cd1e33c2ba5e4f95b7c58bb31cd68875 and project 21831762e5db4beeb272b4e7a206492d. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:15:04.025550 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: bd623d60-9846-40fc-8a68-14d853c81c0f] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:15:04.026613 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:04.027066 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:04.038689 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] [instance: bd623d60-9846-40fc-8a68-14d853c81c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:15:04.040566 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:04.040959 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:04.089207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:04.089544 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-44906049-8727-436b-90c2-0bcef5e0c269 tempest-AttachVolumeNegativeTest-1365020210 tempest-AttachVolumeNegativeTest-1365020210-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:08.771563 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:15:08.817135 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:08.817571 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:08.984394 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:08.985009 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:08.988970 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:08.989943 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:09.063394 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:15:09.082792 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for user 36b49af276e54f8ca4b01a8a708bc1e7 and project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:15:09.128497 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: c77244c4-99a1-492f-8dbf-b8367ea74aab] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:15:09.130591 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:09.131513 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:09.152480 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: c77244c4-99a1-492f-8dbf-b8367ea74aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:15:09.155422 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:09.156527 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:09.244841 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:09.245485 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-265b9527-5f4e-42f2-9206-9f143490dac7 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:18.870953 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:15:44.378717 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:15:44.548772 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:44.550215 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:44.730800 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:44.731825 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:44.734369 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:44.739644 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:44.837173 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Getting quotas for project b5629ace19eb411ca061520c2fbf4926. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:15:44.865971 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Getting quotas for user 44d72c4cc8c54a84a084270fe393b8c0 and project b5629ace19eb411ca061520c2fbf4926. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:15:44.927715 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [instance: b46dd32b-0dbe-44ec-bc02-fcebe9c28571] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:15:44.938384 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:44.939154 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:44.974540 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [instance: b46dd32b-0dbe-44ec-bc02-fcebe9c28571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:15:44.976821 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:44.977535 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:45.110596 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:45.110776 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0bdd71f4-ef63-47ff-ad86-1c40ab998d95 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:46.909361 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:15:48.041467 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42590. Dec 16 19:15:57.254827 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:15:58.305192 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42794. Dec 16 19:16:09.590800 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Took 0.89 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:16:09.659002 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:09.660125 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:09.971509 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:09.971923 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:09.973295 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:09.973894 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:10.072611 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Getting quotas for project 68a19bd00a69428196a4e66eebeb85f9. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:16:10.093894 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Getting quotas for user 4c6815ea2e47407983c4d1924eb8bd2b and project 68a19bd00a69428196a4e66eebeb85f9. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:16:10.136634 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] [instance: 73b27eda-74bd-43d7-9274-be8403055430] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:16:10.143570 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:10.144308 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:10.200717 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] [instance: 73b27eda-74bd-43d7-9274-be8403055430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:16:10.205630 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:10.216355 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:10.347410 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:10.347410 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-9c0e4c27-04bc-4ca5-b7ea-463b60b3360d tempest-InstanceActionsNegativeTestJSON-381187231 tempest-InstanceActionsNegativeTestJSON-381187231-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:29.244256 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:17:50.733557 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:17:51.784212 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45456. Dec 16 19:17:58.344333 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:17:59.401413 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45666. Dec 16 19:18:01.006310 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:18:01.062238 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:01.063027 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:01.133770 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:01.134504 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:01.135392 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:01.135928 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:01.161131 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Getting quotas for project d5437b839d114f87828d56212c37b799. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:18:01.169728 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Getting quotas for user b8e8abb2c87c4793a620bd84a748947c and project d5437b839d114f87828d56212c37b799. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:18:01.184763 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] [instance: 0d5a7659-210e-4575-90d7-96e7b134624b] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:18:01.186204 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:01.186799 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:01.196523 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] [instance: 0d5a7659-210e-4575-90d7-96e7b134624b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:18:01.198849 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:01.199522 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:01.245083 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:01.245550 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-eb1310ad-3d3c-4f4c-8d4d-d8f83a4bc8c4 tempest-VolumesBackupsTest-1182076379 tempest-VolumesBackupsTest-1182076379-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.592015 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Took 4.25 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:18:02.655756 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:02.656239 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.742816 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:02.743699 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.743992 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:02.745361 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.780820 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Getting quotas for project b5629ace19eb411ca061520c2fbf4926. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:18:02.788396 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Getting quotas for user 44d72c4cc8c54a84a084270fe393b8c0 and project b5629ace19eb411ca061520c2fbf4926. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:18:02.806871 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [instance: 5665f8cf-1e5c-45db-91f2-c727f836f8fc] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:18:02.808303 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:02.808834 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.821487 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [instance: 5665f8cf-1e5c-45db-91f2-c727f836f8fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:18:02.823212 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:02.824032 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.908954 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:02.909362 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:02.921006 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:18:03.957924 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c22db03-64d9-4506-b71e-be1e723c5b19 tempest-VolumesSnapshotTestJSON-1183222286 tempest-VolumesSnapshotTestJSON-1183222286-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45808. Dec 16 19:18:29.703980 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Took 0.82 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:18:29.766721 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:29.767421 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:29.905682 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:29.905935 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:29.906972 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:29.907369 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:29.929392 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Getting quotas for project 1bc5c802c3364ac4ae8d09d292fccc26. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:18:29.936430 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Getting quotas for user 053a1acca3824efc836d4c626f21fe4a and project 1bc5c802c3364ac4ae8d09d292fccc26. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:18:29.955826 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] [instance: 99c927d6-4f57-4688-a82f-4f209d97ccc6] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:18:29.957413 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:29.958025 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:29.972471 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] [instance: 99c927d6-4f57-4688-a82f-4f209d97ccc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:18:29.974312 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:29.974687 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:30.035603 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:30.036042 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4c7c1dda-00e0-4955-a97e-d2992d720f9f tempest-VolumesActionsTest-751875428 tempest-VolumesActionsTest-751875428-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:38.899380 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:18:48.037917 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:18:49.166955 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46796. Dec 16 19:18:58.277946 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:18:59.335147 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46916. Dec 16 19:20:03.430682 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:20:03.546272 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:20:04.488924 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48168. Dec 16 19:20:05.427221 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:20:22.560819 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:20:23.614746 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48582. Dec 16 19:20:49.319097 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:20:51.777143 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:20:52.839625 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 49430. Dec 16 19:21:21.269229 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:21:22.367075 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50024. Dec 16 19:21:23.242494 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Took 1.99 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:21:23.337536 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:23.341153 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:23.535121 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:23.540040 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:23.545550 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:23.546955 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:23.621820 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:21:23.651780 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for user 36b49af276e54f8ca4b01a8a708bc1e7 and project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:21:23.682613 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 5138e6a9-79bc-480f-b28f-d6b6987d52ff] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:21:23.684437 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:23.685016 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:23.707953 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 5138e6a9-79bc-480f-b28f-d6b6987d52ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:21:23.709877 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:23.710529 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:23.773112 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:23.774193 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:23.791558 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:21:24.826960 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-24016113-494d-4f35-80f8-fbccf49fa531 tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50070. Dec 16 19:21:49.165507 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:21:50.233025 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50406. Dec 16 19:21:55.186813 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:21:55.261409 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:55.262412 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:55.422563 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:55.422982 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:55.426958 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:55.427371 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:55.474407 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Getting quotas for project 913a77f9f21d4912a71c04398c1006d6. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:21:55.481000 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Getting quotas for user d78c4cffffb844648c5bd814ccd227b3 and project 913a77f9f21d4912a71c04398c1006d6. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:21:55.497574 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] [instance: 95f9a1a4-bcfa-484c-b870-b16491d8b045] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:21:55.499249 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:55.500188 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:55.539182 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] [instance: 95f9a1a4-bcfa-484c-b870-b16491d8b045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:21:55.542541 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:55.543569 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:55.607984 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:55.608572 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-fac2c125-da1b-42eb-98e8-e7968af4c86d tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:58.946314 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:21:59.327208 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:22:00.366759 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50618. Dec 16 19:22:27.024437 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:22:27.096555 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:27.096555 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:27.217747 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:27.218629 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:27.220511 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:27.221177 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:27.244822 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:22:27.251364 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for user 36b49af276e54f8ca4b01a8a708bc1e7 and project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:22:27.266347 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 83685c48-c167-41e1-9c66-d8ccc1d9432e] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:22:27.267873 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:27.268772 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:27.285873 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 83685c48-c167-41e1-9c66-d8ccc1d9432e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:22:27.287674 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:27.288252 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:27.353832 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:27.355055 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d29dd0eb-d66e-49d7-87fc-2c63622c6d9a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:58.472783 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:22:58.508469 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:58.509646 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:58.651680 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:58.652247 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:58.653071 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:58.653554 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:58.672409 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Getting quotas for project 9f584f9cfec44440a09e5ee87abf5536. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:22:58.678358 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Getting quotas for user 0558f100252d49519a6854e30cdd0239 and project 9f584f9cfec44440a09e5ee87abf5536. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:22:58.694394 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] [instance: aeaaf6ab-11f8-4354-8fcd-b77663d5896b] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:22:58.695570 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:58.696098 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:58.706125 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] [instance: aeaaf6ab-11f8-4354-8fcd-b77663d5896b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:22:58.707859 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:58.708721 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:58.755411 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:58.755984 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-3eabb5c7-fd26-48ed-a79c-44f832490c81 tempest-VolumesNegativeTest-560838430 tempest-VolumesNegativeTest-560838430-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.580701 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Took 1.73 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:23:40.672038 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:40.672038 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.793851 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:40.794468 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.795478 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:40.795940 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.815969 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Getting quotas for project 913a77f9f21d4912a71c04398c1006d6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:23:40.823063 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Getting quotas for user d78c4cffffb844648c5bd814ccd227b3 and project 913a77f9f21d4912a71c04398c1006d6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:23:40.835816 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] [instance: d43ce95b-cde0-47f3-b6f4-a48c482a8be1] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:23:40.837824 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:40.838252 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.849649 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] [instance: d43ce95b-cde0-47f3-b6f4-a48c482a8be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:23:40.851207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:40.852012 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.906845 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:40.907544 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-4afd945b-ab66-45b6-8ed2-a94699c9ca6a tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:49.925334 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:23:49.953779 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:49.954207 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:50.161062 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:50.161062 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:50.161062 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:50.161062 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:50.272299 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Getting quotas for project 7cd006eef92b4c2f99bdb394f0d83276. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:23:50.306663 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Getting quotas for user ffde552b368e44d0927627eadc95c6f5 and project 7cd006eef92b4c2f99bdb394f0d83276. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:23:50.338529 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] [instance: a87f0b05-5201-4ed4-a348-23c0a689cf4d] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:23:50.339527 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:50.341923 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:50.359229 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] [instance: a87f0b05-5201-4ed4-a348-23c0a689cf4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:23:50.361064 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:50.361527 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:50.454569 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:50.454999 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-75243f37-99f9-429c-881c-c24eef0486c6 tempest-TestServerAdvancedOps-531383443 tempest-TestServerAdvancedOps-531383443-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:24:09.383793 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:24:50.228064 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:24:51.283210 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53766. Dec 16 19:25:00.365731 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:25:01.406454 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53944. Dec 16 19:25:18.999204 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:25:27.146564 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:25:27.237454 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:27.238107 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:27.372534 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:27.373361 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:27.374390 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:27.374997 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:27.403505 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:25:27.409016 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for user 36b49af276e54f8ca4b01a8a708bc1e7 and project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:25:27.422272 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 363b4524-d951-4c33-a8f6-1e7ec0fcbc24] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:25:27.423619 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:27.424297 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:27.438740 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 363b4524-d951-4c33-a8f6-1e7ec0fcbc24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:25:27.440867 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:27.441541 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:27.510598 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:27.511208 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ee9e672a-25c4-4b02-83fb-5f2e0b0d938e tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:02.761417 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:26:02.837179 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:02.837179 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:03.069436 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:03.070424 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:03.071852 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:03.073270 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:03.105774 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:26:03.190636 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Getting quotas for user 36b49af276e54f8ca4b01a8a708bc1e7 and project 482e270706724e97a6b47a35c085e348. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:26:03.262690 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 55afb6f1-de75-4d25-a708-2079289a5a1c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:26:03.262690 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:03.281901 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:03.320140 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] [instance: 55afb6f1-de75-4d25-a708-2079289a5a1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:26:03.340037 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:03.340037 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:03.532407 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:03.533899 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99d12592-0d8e-42b0-b2bc-57f778ba938a tempest-ServerActionsTestJSON-28285632 tempest-ServerActionsTestJSON-28285632-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:09.446020 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:26:09.497130 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:09.497130 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:09.702307 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:09.702307 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:09.703373 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:09.704003 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:09.741349 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Getting quotas for project 913a77f9f21d4912a71c04398c1006d6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:26:09.751252 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Getting quotas for user d78c4cffffb844648c5bd814ccd227b3 and project 913a77f9f21d4912a71c04398c1006d6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:26:09.777274 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] [instance: d87314b2-d325-437b-a85d-f670efa47e1f] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:26:09.779020 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:09.779855 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:09.796907 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] [instance: d87314b2-d325-437b-a85d-f670efa47e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:26:09.800157 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:09.801223 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:09.904230 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:09.904880 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0c15f538-e770-41ac-91a1-09d25dcce395 tempest-TestNetworkBasicOps-2043395617 tempest-TestNetworkBasicOps-2043395617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:34.624053 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:26:34.660546 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:34.661088 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:34.750641 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:34.751533 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:34.753008 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:34.753801 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:34.797290 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Getting quotas for project eae79734fb67492d8284fcd4142da3e9. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:26:34.807216 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Getting quotas for user 373a5067165147c1b69f10d77713cb8a and project eae79734fb67492d8284fcd4142da3e9. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:26:34.828554 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] [instance: 8facb455-e3df-49ea-b4b8-cf7e9bce355a] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:26:34.829828 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:34.830445 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:34.840570 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] [instance: 8facb455-e3df-49ea-b4b8-cf7e9bce355a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:26:34.842528 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:34.843403 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:34.897250 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:26:34.898070 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-68516a87-674a-4caa-8fdc-0d9f5120f5ac tempest-ServerMetadataNegativeTestJSON-81143617 tempest-ServerMetadataNegativeTestJSON-81143617-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:26.613828 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:27:26.656941 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:26.657524 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:26.761579 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:26.762065 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:26.762897 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:26.763347 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:26.803800 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Getting quotas for project 219483597e714dbb8fea0eaec75e0a96. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:27:26.813459 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Getting quotas for user c7efae7560a44c848428bcc5b5478ec7 and project 219483597e714dbb8fea0eaec75e0a96. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:27:26.828976 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] [instance: 41a77137-1bed-4d40-ad94-9852ee01d97c] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:27:26.833440 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:26.834132 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:26.851369 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] [instance: 41a77137-1bed-4d40-ad94-9852ee01d97c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:27:26.852959 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:26.853534 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:26.918013 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:26.918519 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-fd4aacfc-4b14-4eb4-b5a9-d5227144a332 tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:29.466770 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:27:36.998562 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:27:37.041116 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:37.042882 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:37.141528 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:37.142750 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:37.144245 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:37.144863 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:37.186542 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Getting quotas for project e9247de777b54778b56d90c622467dbe. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:27:37.196718 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Getting quotas for user 480d59a273f4438798558b10566dbec6 and project e9247de777b54778b56d90c622467dbe. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:27:37.218587 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] [instance: 826e91e2-862b-405b-ae12-b52dc6cd77fb] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:27:37.220140 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:37.220772 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:37.238380 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] [instance: 826e91e2-862b-405b-ae12-b52dc6cd77fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:27:37.240883 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:37.241844 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:37.295779 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:37.300051 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-bc3a0c2b-1067-46cc-bca3-01d1e2e2c70b tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:51.283937 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:27:52.302405 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 56436. Dec 16 19:28:01.404836 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:28:02.439847 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 56532. Dec 16 19:28:35.816427 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:35.906866 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:35.909862 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:36.029363 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:36.030042 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:36.031901 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:36.032581 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:36.079597 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Getting quotas for project e9247de777b54778b56d90c622467dbe. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:36.091530 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Getting quotas for user 480d59a273f4438798558b10566dbec6 and project e9247de777b54778b56d90c622467dbe. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:36.121279 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] [instance: 84c3a1a5-350b-4c06-9b7a-aefc72f07b85] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:36.123655 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:36.124914 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:36.144480 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] [instance: 84c3a1a5-350b-4c06-9b7a-aefc72f07b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:36.153642 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:36.154929 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:36.256154 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:36.256997 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-54288c20-ece0-4fe8-b066-5bbddab4e7d8 tempest-ServerRescueTestJSON-1075323988 tempest-ServerRescueTestJSON-1075323988-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:39.067073 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:28:46.229650 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:46.267078 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.267877 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:46.345062 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.346255 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:46.347278 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.347897 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:46.383165 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Getting quotas for project 219483597e714dbb8fea0eaec75e0a96. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:46.397179 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Getting quotas for user c7efae7560a44c848428bcc5b5478ec7 and project 219483597e714dbb8fea0eaec75e0a96. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:46.433219 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] [instance: 5224ff63-292c-4500-95a5-2096fee51575] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:46.434632 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.435498 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:46.456894 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] [instance: 5224ff63-292c-4500-95a5-2096fee51575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:46.458800 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.459557 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:46.553804 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.561181 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e66ed86f-380b-4c1c-bfaa-250a2dc5031f tempest-TestSecurityGroupsBasicOps-1490464398 tempest-TestSecurityGroupsBasicOps-1490464398-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.954017 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Took 0.91 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:48.013083 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:48.015154 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:48.148175 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:48.153836 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:48.163360 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:48.164119 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:48.208000 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Getting quotas for project 6091f098cc7041c6a15b0f9ad7dc7d89. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:48.215038 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Getting quotas for user f22db7a1134147e1855d50ee5b50ba12 and project 6091f098cc7041c6a15b0f9ad7dc7d89. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:48.248940 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] [instance: adee9542-aca0-4792-9c3f-28cb7f5877ad] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:48.250968 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:48.255729 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:48.298491 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] [instance: adee9542-aca0-4792-9c3f-28cb7f5877ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:48.303688 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:48.307150 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:48.456112 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:48.457259 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-9560861a-9f50-4e7d-97c4-98a02f91c5fb tempest-ServerPasswordTestJSON-940289263 tempest-ServerPasswordTestJSON-940289263-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:13.046537 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:29:13.076103 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:13.076747 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:13.192406 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:13.193236 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:13.194716 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:13.196260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:13.241665 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Getting quotas for project b88aa2088d6046a39f7eb1e872f3281e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:29:13.267907 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Getting quotas for user 80caf61df05b42d485f942cd4a0cf4e2 and project b88aa2088d6046a39f7eb1e872f3281e. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:29:13.310862 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] [instance: 28fe6d97-5c63-4455-a3b7-4ff5faea7830] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:29:13.312264 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:13.313135 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:13.324995 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] [instance: 28fe6d97-5c63-4455-a3b7-4ff5faea7830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:29:13.326764 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:13.329194 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:13.420580 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:13.422459 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-98d04eaf-c226-4364-a4cd-925ce686675f tempest-TestServerBasicOps-27264810 tempest-TestServerBasicOps-27264810-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:29.352193 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:29:29.400112 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:29.407200 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:29.511956 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:29.512491 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:29.513229 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:29.513617 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:29.539044 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Getting quotas for project fb2d9ac0101e4eefaa4f80db079a9797. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:29:29.545119 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Getting quotas for user cd6dfc34ebb744de86c5633961262214 and project fb2d9ac0101e4eefaa4f80db079a9797. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:29:29.559118 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] [instance: 62bd0d16-4308-4781-96c8-56b69d196181] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:29:29.560517 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:29.560864 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:29.571641 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] [instance: 62bd0d16-4308-4781-96c8-56b69d196181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:29:29.577668 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:29.578253 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:29.645413 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:29.645991 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3cd04f3d-fa2b-412a-9ed7-82b77196c9fb tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:30.969098 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:29:31.030648 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:31.031317 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:31.134232 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:31.135449 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:31.137049 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:31.137751 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:31.160591 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Getting quotas for project fb2d9ac0101e4eefaa4f80db079a9797. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:29:31.168508 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Getting quotas for user cd6dfc34ebb744de86c5633961262214 and project fb2d9ac0101e4eefaa4f80db079a9797. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:29:31.207117 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] [instance: 1d6567e5-c26b-4bf6-b93d-e22df7b2c170] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:29:31.214715 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:31.215226 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:31.235974 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] [instance: 1d6567e5-c26b-4bf6-b93d-e22df7b2c170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:29:31.236923 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:31.237346 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:31.360855 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:31.361708 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-80ad794a-26b5-46ee-b060-1f37cc95305c tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:38.942134 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-397da7a3-b330-4335-97cc-a19d709d50ec tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:29:38.942773 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-397da7a3-b330-4335-97cc-a19d709d50ec tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:38.950557 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-397da7a3-b330-4335-97cc-a19d709d50ec tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:38.996188 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-397da7a3-b330-4335-97cc-a19d709d50ec tempest-ServerShowV247Test-537053587 tempest-ServerShowV247Test-537053587-project] [instance: 1d6567e5-c26b-4bf6-b93d-e22df7b2c170] No migration record for the rebuild/evacuate request. {{(pid=89821) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:30:16.766412 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:30:16.810670 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:16.811359 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:16.887292 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:16.888162 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:16.889170 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:16.889871 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:16.915468 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Getting quotas for project 8f9d2f34ff0c48009fa03e6b6a82a284. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:30:16.923030 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Getting quotas for user c0e9bd1f650b461c9645fb549dfe5971 and project 8f9d2f34ff0c48009fa03e6b6a82a284. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:30:16.939456 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] [instance: d834f8af-1f1c-4112-83f1-d08cf7e1033e] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:30:16.941273 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:16.941847 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:16.953487 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] [instance: d834f8af-1f1c-4112-83f1-d08cf7e1033e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:30:16.956656 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:16.957638 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:17.022993 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:17.023390 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-4706ea18-1ab8-43a8-9ac9-29533d635143 tempest-ServerRescueTestJSONUnderV235-553865786 tempest-ServerRescueTestJSONUnderV235-553865786-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:41.612579 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Took 0.90 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:30:41.732177 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:41.736664 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:42.000477 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:42.001353 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:42.005595 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:42.006858 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:42.086708 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Getting quotas for project 3a1dbf41e2864e3cad362152da4170cb. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:30:42.108980 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Getting quotas for user 1995013506a344f4af3488b2303158aa and project 3a1dbf41e2864e3cad362152da4170cb. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:30:42.165850 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] [instance: a174e4f9-a434-4ce4-a5ba-23e5128570bb] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:30:42.167920 n-d-821350-1 nova-conductor[89821]: DEBUG nova.scheduler.utils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-821350-1']) and/or node ([]) {{(pid=89821) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Dec 16 19:30:42.169491 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:42.174955 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:42.201845 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] [instance: a174e4f9-a434-4ce4-a5ba-23e5128570bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:30:42.212061 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:42.213105 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:42.309224 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:42.311874 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-375fab42-2861-4073-9b16-1f072fa9f8d5 tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:52.302396 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:30:53.324222 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 59312. Dec 16 19:31:02.440575 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:31:03.464509 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 59494. Dec 16 19:31:10.915240 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:31:10.961754 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:10.962591 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:11.027245 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:11.027846 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:11.028796 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:11.029309 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:11.048915 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Getting quotas for project 3a1dbf41e2864e3cad362152da4170cb. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:31:11.054316 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Getting quotas for user 1995013506a344f4af3488b2303158aa and project 3a1dbf41e2864e3cad362152da4170cb. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:31:11.070742 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] [instance: 89a6a0f4-b8fd-4d5e-ba65-2cc4b393f5fb] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:31:11.071501 n-d-821350-1 nova-conductor[89822]: DEBUG nova.scheduler.utils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-821350-1']) and/or node ([]) {{(pid=89822) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Dec 16 19:31:11.072609 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:11.073840 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:11.083170 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] [instance: 89a6a0f4-b8fd-4d5e-ba65-2cc4b393f5fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:31:11.085172 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:11.092617 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:11.152636 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:11.153386 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-21820690-32c8-4fa4-93df-b9e3d6005b1e tempest-TestServerMultinode-919509704 tempest-TestServerMultinode-919509704-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:28.719507 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:31:28.751168 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:28.751884 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:28.907117 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:28.907768 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:28.909195 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:28.909821 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:29.004861 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:31:29.025779 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for user dca03ca0609d4e9b92700401c521df99 and project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:31:29.074458 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: 95ae0966-fafc-4a63-bac2-6eb3d2a675cd] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:31:29.075725 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:29.075922 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:29.097337 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: 95ae0966-fafc-4a63-bac2-6eb3d2a675cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:31:29.098941 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:29.099341 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:29.174573 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:29.174966 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-db1b53ea-3b0f-4cb2-81fd-00d8899cc50e tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:45.877162 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:31:45.903594 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:45.903992 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:45.968811 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:45.969518 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:45.970749 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:45.971713 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:45.992149 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Getting quotas for project e8ed68b343094452bb30bd1315b099bb. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:31:45.998718 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Getting quotas for user 8617ce766dfc462f9d345e5cd5aac462 and project e8ed68b343094452bb30bd1315b099bb. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:31:46.013221 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] [instance: 42aca071-c7ca-4cae-bf25-07c1023b0689] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:31:46.014251 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:46.014630 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:46.025093 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] [instance: 42aca071-c7ca-4cae-bf25-07c1023b0689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:31:46.026436 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:46.026838 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:46.067490 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:46.068058 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-e83e9d81-f86e-4944-b46d-bede00b25ab0 tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:51.179767 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-be33607c-c653-462b-9676-c4a45ae5dd3b tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:31:51.182529 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-be33607c-c653-462b-9676-c4a45ae5dd3b tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:51.188678 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-be33607c-c653-462b-9676-c4a45ae5dd3b tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:51.247368 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-be33607c-c653-462b-9676-c4a45ae5dd3b tempest-ServerShowV254Test-488972293 tempest-ServerShowV254Test-488972293-project] [instance: 42aca071-c7ca-4cae-bf25-07c1023b0689] No migration record for the rebuild/evacuate request. {{(pid=89821) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:31:59.116163 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:32:28.775480 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:32:28.800343 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:28.800734 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:28.855388 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:28.855815 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:28.856568 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:28.857085 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:28.875194 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Getting quotas for project 8121eff7507342ab95c433692e657335. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:32:28.880151 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Getting quotas for user b912441cdab24405805ae9d9ad1bfc0d and project 8121eff7507342ab95c433692e657335. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:32:28.893243 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] [instance: 89f0f2d6-e482-494a-b3dd-a4aa59ee01fa] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:32:28.894272 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:28.894703 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:28.901841 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] [instance: 89f0f2d6-e482-494a-b3dd-a4aa59ee01fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:32:28.903226 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:28.903671 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:28.937146 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:28.937628 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-8971f819-a550-48a3-921d-d3e5d7f411b8 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:45.775886 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:32:45.818326 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:45.818968 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:45.885919 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:45.886582 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:45.887601 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:45.888218 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:45.922336 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Getting quotas for project 8121eff7507342ab95c433692e657335. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:32:45.931339 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Getting quotas for user b912441cdab24405805ae9d9ad1bfc0d and project 8121eff7507342ab95c433692e657335. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:32:45.954014 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] [instance: e9901ede-b11d-4ac0-9988-914200eb359b] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:32:45.955591 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:45.956261 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:45.966141 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] [instance: e9901ede-b11d-4ac0-9988-914200eb359b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:32:45.967472 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:45.967889 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:46.003195 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:46.003673 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-2d730119-f5cb-41d0-9bf8-6a0263334854 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:57.672608 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-5b0bef1a-d04c-4f88-923b-bc565ba3074c tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:32:57.673544 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5b0bef1a-d04c-4f88-923b-bc565ba3074c tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:57.674065 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5b0bef1a-d04c-4f88-923b-bc565ba3074c tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:57.948795 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-5b0bef1a-d04c-4f88-923b-bc565ba3074c tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] [instance: 95ae0966-fafc-4a63-bac2-6eb3d2a675cd] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89822) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:32:58.516195 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-5b0bef1a-d04c-4f88-923b-bc565ba3074c tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Created allocations for migration 453ad3bc-c833-4160-bcc5-55045d038754 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:32:58.855908 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-5b0bef1a-d04c-4f88-923b-bc565ba3074c tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] [instance: 95ae0966-fafc-4a63-bac2-6eb3d2a675cd] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [] {{(pid=89822) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:33:53.324497 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:33:54.358077 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 33530. Dec 16 19:34:03.464712 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:34:04.497075 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 33578. Dec 16 19:34:35.176100 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-50b95695-6f85-44ae-bb12-c05c81e312f3 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method unshelve_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:34:35.177185 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-50b95695-6f85-44ae-bb12-c05c81e312f3 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:35.177665 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-50b95695-6f85-44ae-bb12-c05c81e312f3 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:35.667076 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-50b95695-6f85-44ae-bb12-c05c81e312f3 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] [instance: 89f0f2d6-e482-494a-b3dd-a4aa59ee01fa] Requesting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) during scheduling {{(pid=89821) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 19:34:36.600242 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-50b95695-6f85-44ae-bb12-c05c81e312f3 tempest-ServersNegativeTestJSON-1583268454 tempest-ServersNegativeTestJSON-1583268454-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:34:58.339388 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Took 1.23 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:34:58.405276 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:58.405716 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:58.548395 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:58.549113 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:58.550052 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:58.550625 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:58.596048 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:34:58.603465 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for user dca03ca0609d4e9b92700401c521df99 and project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:34:58.618478 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: b1586b44-608d-4999-8bc9-ecdfdc57b4fa] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:34:58.625260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:58.626187 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:58.636242 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: b1586b44-608d-4999-8bc9-ecdfdc57b4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:34:58.639575 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:58.640183 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:58.710790 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:58.711461 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-6ab40b76-9175-4e45-8c52-65b8482e100f tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:19.143384 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:35:52.248295 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-1bbd003a-b264-4ebf-ba1e-c012f5c509c5 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:35:52.251129 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1bbd003a-b264-4ebf-ba1e-c012f5c509c5 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:52.252129 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1bbd003a-b264-4ebf-ba1e-c012f5c509c5 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:52.510802 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-1bbd003a-b264-4ebf-ba1e-c012f5c509c5 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] [instance: b1586b44-608d-4999-8bc9-ecdfdc57b4fa] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:35:53.371172 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-1bbd003a-b264-4ebf-ba1e-c012f5c509c5 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Created allocations for migration 36e55bc6-5c9c-42a1-a910-c00b753e4125 on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:35:53.779785 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-1bbd003a-b264-4ebf-ba1e-c012f5c509c5 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] [instance: b1586b44-608d-4999-8bc9-ecdfdc57b4fa] Calling prep_resize with selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:36:25.819426 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:36:25.907617 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:36:25.908027 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:36:25.998391 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:36:25.999126 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:36:26.000215 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:36:26.000606 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:36:26.059229 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Getting quotas for project 226871c5f5b94af995ec970de1ed05c8. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:36:26.064878 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Getting quotas for user 604bcebfe43544b78f1026b341eeb757 and project 226871c5f5b94af995ec970de1ed05c8. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:36:26.091800 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] [instance: 1952250b-49dd-4fd9-b055-bc9a654d5930] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:36:26.092784 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:36:26.093191 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:36:26.116069 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] [instance: 1952250b-49dd-4fd9-b055-bc9a654d5930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:36:26.117961 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:36:26.118615 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:36:26.184327 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:36:26.184731 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-26151100-a7c8-484f-8f6d-08efcd56a834 tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:36:54.356377 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:36:55.409045 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 35206. Dec 16 19:37:04.495315 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:37:05.525820 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 35332. Dec 16 19:37:29.551454 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:37:52.669378 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:37:52.701951 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:37:52.702365 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:37:52.780842 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:37:52.781562 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:37:52.782315 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:37:52.782869 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:37:52.810497 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:37:52.817391 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for user dca03ca0609d4e9b92700401c521df99 and project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:37:52.837428 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: a5f8ea9c-dd59-499e-bb41-d8e349c0ccd7] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:37:52.838795 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:37:52.839367 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:37:52.866395 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: a5f8ea9c-dd59-499e-bb41-d8e349c0ccd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:37:52.879140 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:37:52.879790 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:37:53.006668 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:37:53.007652 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8c30a3a4-66c5-4e8b-b172-de494302d3be tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:38:39.201177 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:38:39.633427 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:38:39.633427 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:38:39.633427 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:38:40.266495 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Created allocations for migration 3ef60bb1-849d-495f-8738-088a9fc3aafa on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:38:40.684894 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.live_migrate [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] [instance: a5f8ea9c-dd59-499e-bb41-d8e349c0ccd7] Requesting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while live migrating {{(pid=89822) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:495}} Dec 16 19:38:41.165559 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lazy-loading 'resources' on Instance uuid a5f8ea9c-dd59-499e-bb41-d8e349c0ccd7 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:38:41.165559 n-d-821350-1 nova-conductor[89822]: DEBUG nova.objects.instance [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] Lazy-loading 'pci_requests' on Instance uuid a5f8ea9c-dd59-499e-bb41-d8e349c0ccd7 {{(pid=89822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:38:41.613142 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.live_migrate [None req-33241ec7-b6a5-4992-bcdf-17cc1063c138 tempest-TestNetworkAdvancedServerOps-1001551672 tempest-TestNetworkAdvancedServerOps-1001551672-project-admin] [instance: a5f8ea9c-dd59-499e-bb41-d8e349c0ccd7] Start binding ports on destination host: n-h2-821350-1 {{(pid=89822) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 19:39:37.234290 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:39:37.290074 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.291858 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:37.402118 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.402785 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:37.404338 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.405176 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:37.495548 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:39:37.515791 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Getting quotas for user dca03ca0609d4e9b92700401c521df99 and project 36d2c32a74de4868942020435acee3f7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:39:37.583062 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: b6304618-4fa2-4aae-b66f-ba2c96a2afc8] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:39:37.584861 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.587906 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:37.618656 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: b6304618-4fa2-4aae-b66f-ba2c96a2afc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:39:37.620221 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.620751 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:37.719722 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.720465 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38c2cb72-8c88-48f9-a126-d5c1e062f8bc tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:37.932667 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:39:37.998644 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:37.999336 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:38.122497 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:38.123437 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:38.124908 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:38.125763 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:38.172444 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Getting quotas for project fab5f2daed5b4fae9a7178ca90ca45cd. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:39:38.186643 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Getting quotas for user 981ee24a53db4398a7cedadb7252a250 and project fab5f2daed5b4fae9a7178ca90ca45cd. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:39:38.213241 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] [instance: 0e6955cd-af83-481b-b00d-602943cfccc4] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:39:38.215077 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:38.216328 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:38.229085 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] [instance: 0e6955cd-af83-481b-b00d-602943cfccc4] block_device_mapping [BlockDeviceMapping(attachment_id=3c37d2be-9247-467f-aa49-8a9d9e84bbd8,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d13a2f09-3ed3-480b-938b-54955da11081',volume_size=1,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:39:38.232251 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:38.232991 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:39:38.292901 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:39:38.293649 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a5f3e074-f932-4bd2-b842-c97430b6e1bc tempest-TestVolumeBackupRestore-814428462 tempest-TestVolumeBackupRestore-814428462-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:05.522465 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:40:06.557733 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 37622. Dec 16 19:40:29.179764 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c122a7a2-b6ba-4f11-b542-a056b9a8d450 tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method rebuild_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:40:29.180700 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c122a7a2-b6ba-4f11-b542-a056b9a8d450 tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:29.183219 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c122a7a2-b6ba-4f11-b542-a056b9a8d450 tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:29.223777 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c122a7a2-b6ba-4f11-b542-a056b9a8d450 tempest-TestNetworkAdvancedServerOps-1418333900 tempest-TestNetworkAdvancedServerOps-1418333900-project] [instance: b6304618-4fa2-4aae-b66f-ba2c96a2afc8] No migration record for the rebuild/evacuate request. {{(pid=89821) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:40:55.409945 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:40:56.439386 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 38198. Dec 16 19:41:32.852486 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:41:32.893212 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:32.894678 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:32.982555 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:32.983359 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:32.984190 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:32.984660 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:33.003705 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:41:33.009283 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:41:33.024044 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 3fd9828d-069d-4901-bd46-c4ce2ca63804] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:41:33.025003 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:33.025627 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:33.038714 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 3fd9828d-069d-4901-bd46-c4ce2ca63804] block_device_mapping [BlockDeviceMapping(attachment_id=3a8c53b5-7bbf-40c7-aea8-4c152ce6495a,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7cf8d42-efe9-4007-83d6-b3b137e8cec6',volume_size=1,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:41:33.040125 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:33.040632 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:33.079298 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:33.079981 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-5c96dbc3-b300-4d90-9209-c53625b2ee1c tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:52.851227 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:41:53.868697 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 38522. Dec 16 19:41:59.286696 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:42:19.716553 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:42:19.760870 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.761621 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.839575 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.840145 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.841032 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.841617 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.862172 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:42:19.868365 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:42:19.883223 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: badbe901-b027-41d7-99c4-7b8eb4d6ca36] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:42:19.884242 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.884750 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.894260 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: badbe901-b027-41d7-99c4-7b8eb4d6ca36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0160101d-9dfe-456d-9531-908260a15673',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:42:19.895880 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.896385 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.938395 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.939172 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-dd654178-7dde-41ae-9ed2-018b8e79cec8 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:29.598904 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:42:31.868099 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:42:31.900104 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:31.900507 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:31.977629 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:31.978356 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:31.980296 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:31.980296 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:32.009192 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Getting quotas for project 226871c5f5b94af995ec970de1ed05c8. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:42:32.015331 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Getting quotas for user 604bcebfe43544b78f1026b341eeb757 and project 226871c5f5b94af995ec970de1ed05c8. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:42:32.027832 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] [instance: 737aaee1-bdcc-4c68-9a0e-6cb52d160250] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:42:32.028828 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:32.029228 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:32.038244 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] [instance: 737aaee1-bdcc-4c68-9a0e-6cb52d160250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:42:32.040054 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:32.040659 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:32.112129 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:32.112961 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-2bca75e1-a297-4411-8b51-839afc23b3ad tempest-AttachVolumeTestJSON-103708648 tempest-AttachVolumeTestJSON-103708648-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:06.559013 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:43:07.576645 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 38956. Dec 16 19:43:21.482899 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:43:21.524838 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:21.525379 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:21.585275 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:21.585581 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:21.586350 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:21.586749 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:21.604719 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:43:21.610893 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:43:21.623639 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 065546bf-2f1f-45fa-995d-373fa6209331] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:43:21.624650 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:21.625090 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:21.633035 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 065546bf-2f1f-45fa-995d-373fa6209331] block_device_mapping [BlockDeviceMapping(attachment_id=3561ef1e-dfc1-4b51-871d-02b6d613ade7,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b66cb03-a630-4155-b29c-eecb7db8bfff',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:43:21.634572 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:21.635083 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:21.669144 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:21.669661 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-38328102-cb3b-4da8-aa58-3fc44ebbc80d tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:43.940077 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:43:43.964904 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:43.965415 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:44.043223 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:44.043920 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:44.044658 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:44.045057 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:44.063738 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:43:44.069281 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:43:44.083557 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 84982f48-6f64-44aa-bb6b-afba2cefa11c] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:43:44.085099 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:44.085714 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:44.095313 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 84982f48-6f64-44aa-bb6b-afba2cefa11c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f73ee91a-153b-4e00-a47c-5242f37cbdc2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:43:44.097141 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:44.097714 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:44.153050 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:44.153606 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-baa5acd2-0694-414c-ae5f-5423b5e9cdf5 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:56.439955 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:43:57.455185 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39252. Dec 16 19:44:56.816183 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:44:56.847456 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:44:56.847854 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:44:56.910347 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:44:56.910657 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:44:56.911368 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:44:56.911771 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:44:56.930783 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:44:56.935597 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:44:56.948586 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 9eba5ba8-117b-421a-ae4f-60fba599dd7b] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:44:56.949111 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:44:56.949496 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:44:56.959355 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: 9eba5ba8-117b-421a-ae4f-60fba599dd7b] block_device_mapping [BlockDeviceMapping(attachment_id=0443de50-e4c7-4950-9b62-9913f2bae41b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f21e7a35-b517-4a94-9c1a-d649d6816b34',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:44:56.961242 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:44:56.961900 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:44:57.007258 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:44:57.007676 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-d8e57957-0920-4339-9102-4b6857292011 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:45:19.331301 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:45:49.625805 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:46:04.506598 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:46:05.533915 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 40006. Dec 16 19:46:07.578957 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:46:08.597933 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 40042. Dec 16 19:46:23.625491 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:46:24.650573 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 40288. Dec 16 19:46:43.651129 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:46:45.513919 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:46:57.455248 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:46:58.481240 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 40870. Dec 16 19:47:22.964704 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:47:23.007218 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:23.007887 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:23.083281 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:23.083691 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:23.084424 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:23.084820 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:23.107153 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:47:23.113133 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:47:23.127050 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: f24d8c68-b038-4566-91d6-3198962cbcfe] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:47:23.128243 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:23.128639 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:23.139279 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: f24d8c68-b038-4566-91d6-3198962cbcfe] block_device_mapping [BlockDeviceMapping(attachment_id=bb1d850a-9774-4848-b2da-21f38d57844b,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f21e7a35-b517-4a94-9c1a-d649d6816b34',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:47:23.141284 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:23.141955 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:23.185481 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:23.186271 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-bb256b4d-057f-49a5-b7c4-02ddf9d0cab9 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:39.365511 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:49:05.535397 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:49:06.565760 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42136. Dec 16 19:49:08.598539 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:49:09.617943 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42184. Dec 16 19:49:09.646428 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:49:23.551129 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:49:24.572368 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42240. Dec 16 19:49:24.644062 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:49:25.670321 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42256. Dec 16 19:49:38.029484 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:49:39.044439 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42518. Dec 16 19:49:39.529487 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Took 1.51 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:49:39.554265 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:39.554673 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:39.613503 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:39.614232 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:39.615483 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:39.616174 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:39.644135 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:49:39.652551 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Getting quotas for user 2777c03ec987470b8a9f60f04c30655e and project 2cc37f89c10841048c2250e643f655df. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:49:39.669839 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: f433459c-8683-48fc-8a74-9a87962d8622] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:49:39.670920 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:39.671340 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:39.680886 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [instance: f433459c-8683-48fc-8a74-9a87962d8622] block_device_mapping [BlockDeviceMapping(attachment_id=1979a79e-7097-4d11-b9c3-812a0496f821,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15c88c48-1b58-48d4-af62-d6e61807fd74',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:49:39.682881 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:39.683331 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:39.721091 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:39.721485 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:39.731743 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:49:40.748525 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-a101f478-67b1-44e8-9c29-262f213c7ea7 tempest-TestVolumeBootPattern-1592736059 tempest-TestVolumeBootPattern-1592736059-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42580. Dec 16 19:49:58.481048 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:49:59.499737 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 43084. Dec 16 19:50:03.678804 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:50:05.532964 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:51:53.879580 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:51:54.908342 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 44410. Dec 16 19:51:59.395222 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:52:06.572171 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:52:07.698900 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 44572. Dec 16 19:52:09.624774 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:52:10.657354 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 44616. Dec 16 19:52:24.568739 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:52:25.591331 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45170. Dec 16 19:52:25.665038 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:52:26.713771 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 45198. Dec 16 19:52:29.671938 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:52:59.500221 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:53:00.523273 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46120. Dec 16 19:53:23.706850 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:53:25.554985 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:54:01.369539 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:54:02.386623 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] [e4089c33-0558-401b-ba58-abc88b5ad14b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46522. Dec 16 19:54:02.605223 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Took 1.24 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:54:02.628567 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:02.628968 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:02.683924 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:02.684323 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:02.685041 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:02.685426 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:02.700757 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Getting quotas for project 929b77c91b0d46f0be7a6b7b94af61e1. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:54:02.705197 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Getting quotas for user b66dd63cfd2c4fd9b33100b35e6662ee and project 929b77c91b0d46f0be7a6b7b94af61e1. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:54:02.715724 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] [instance: d0433b70-0b9a-4dcc-9551-a6d79df67095] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:54:02.716646 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:02.717091 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:02.725034 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] [instance: d0433b70-0b9a-4dcc-9551-a6d79df67095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:54:02.726281 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:02.726704 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:02.756537 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:02.757074 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:02.765631 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:54:03.782371 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-f88cccd5-a73e-4e5c-b188-3fff9b34f57c tempest-ServersAdminNegativeTestJSON-886720735 tempest-ServersAdminNegativeTestJSON-886720735-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46542. Dec 16 19:54:28.469565 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:54:28.493784 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:28.494091 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:28.548173 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:28.548571 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:28.549291 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:28.549680 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:28.572685 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Getting quotas for project 7fc65c7c28c04e03a787c27526992d00. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:54:28.577708 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Getting quotas for user 3d4d461a5fcf436db601eca7edba82c3 and project 7fc65c7c28c04e03a787c27526992d00. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:54:28.588938 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] [instance: 68e24ee4-856e-44c4-959e-28bf527fcf90] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:54:28.589895 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:28.590319 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:28.597010 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] [instance: 68e24ee4-856e-44c4-959e-28bf527fcf90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:54:28.598231 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:28.598622 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:28.628073 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:28.628529 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-56d1338d-f667-429e-82de-1803231db49b tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:41.659925 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a0bc0b4b-7f77-4a09-a05b-b2b54dd9e6e6 tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:54:41.660550 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0bc0b4b-7f77-4a09-a05b-b2b54dd9e6e6 tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:41.660780 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0bc0b4b-7f77-4a09-a05b-b2b54dd9e6e6 tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:41.887003 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-a0bc0b4b-7f77-4a09-a05b-b2b54dd9e6e6 tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] [instance: 68e24ee4-856e-44c4-959e-28bf527fcf90] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:54:42.195059 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-a0bc0b4b-7f77-4a09-a05b-b2b54dd9e6e6 tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] Created allocations for migration fc553adb-c3ab-43c0-955d-838fc13e010a on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:54:42.573914 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-a0bc0b4b-7f77-4a09-a05b-b2b54dd9e6e6 tempest-DeleteServersTestJSON-34533151 tempest-DeleteServersTestJSON-34533151-project] [instance: 68e24ee4-856e-44c4-959e-28bf527fcf90] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"2ec5f0ed-a520-4003-9f1a-57c72c316219": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["2ec5f0ed-a520-4003-9f1a-57c72c316219"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=2ec5f0ed-a520-4003-9f1a-57c72c316219,limits=SchedulerLimits,nodename='n-h2-821350-1',service_host='n-h2-821350-1')] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:55:10.655462 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:55:11.673344 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 46826. Dec 16 19:55:19.417412 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:55:26.539907 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:55:26.564651 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:26.565049 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:26.624305 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:26.624965 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:26.625777 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:26.626303 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:26.646870 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Getting quotas for project 74a8fa43b8bc476cb22938e4d13d8532. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:55:26.652243 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Getting quotas for user 9f62c264a683476ab2acc57efd1792ea and project 74a8fa43b8bc476cb22938e4d13d8532. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:55:26.663343 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 031b79e3-287b-4ab2-8c79-14eb6b6da1ff] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:55:26.664280 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:26.664679 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:26.672255 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 031b79e3-287b-4ab2-8c79-14eb6b6da1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:55:26.673413 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:26.673809 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:26.708245 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:26.708922 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-99199efb-36de-4d8c-adf3-87bf8f33b640 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:39.893813 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c004a4a5-1355-4919-b76b-16d98a424648 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:55:39.894882 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c004a4a5-1355-4919-b76b-16d98a424648 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:39.895526 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c004a4a5-1355-4919-b76b-16d98a424648 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:40.149187 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-c004a4a5-1355-4919-b76b-16d98a424648 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 031b79e3-287b-4ab2-8c79-14eb6b6da1ff] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:55:40.616294 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-c004a4a5-1355-4919-b76b-16d98a424648 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Created allocations for migration 677515e3-b713-4ab5-ac33-da4a8d2e2ecc on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:55:40.858835 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-c004a4a5-1355-4919-b76b-16d98a424648 tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 031b79e3-287b-4ab2-8c79-14eb6b6da1ff] Calling prep_resize with selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"f3e8aa33-a634-4f3a-8683-94d69edc9cc6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["f3e8aa33-a634-4f3a-8683-94d69edc9cc6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=f3e8aa33-a634-4f3a-8683-94d69edc9cc6,limits=SchedulerLimits,nodename='n-h1-821350-1',service_host='n-h1-821350-1')] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:55:49.692561 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:56:00.521454 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:56:01.550042 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47034. Dec 16 19:56:10.987033 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:56:11.011968 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:11.012492 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:11.080253 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:11.080925 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:11.082822 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:11.083483 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:11.111147 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Getting quotas for project 74a8fa43b8bc476cb22938e4d13d8532. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:56:11.119798 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Getting quotas for user 9f62c264a683476ab2acc57efd1792ea and project 74a8fa43b8bc476cb22938e4d13d8532. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:56:11.137877 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 19a24b59-2ac4-4bfb-8441-652dfb64f675] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:56:11.139370 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:11.139781 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:11.149591 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 19a24b59-2ac4-4bfb-8441-652dfb64f675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:56:11.151177 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:11.151668 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:11.186601 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:11.187077 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-a3afb5b9-f594-4fdb-a1cf-9ec66f6c39bb tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:24.773280 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c2c0b36c-73e0-4881-9d09-9762860616ba tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:56:24.774340 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c2c0b36c-73e0-4881-9d09-9762860616ba tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:24.774877 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c2c0b36c-73e0-4881-9d09-9762860616ba tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:24.902957 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-c2c0b36c-73e0-4881-9d09-9762860616ba tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 19a24b59-2ac4-4bfb-8441-652dfb64f675] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:56:25.261866 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-c2c0b36c-73e0-4881-9d09-9762860616ba tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] Created allocations for migration d12a995e-51da-4907-bbf9-8a0969a6b9c8 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:56:25.515671 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-c2c0b36c-73e0-4881-9d09-9762860616ba tempest-ServerDiskConfigTestJSON-1017825480 tempest-ServerDiskConfigTestJSON-1017825480-project] [instance: 19a24b59-2ac4-4bfb-8441-652dfb64f675] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"2ec5f0ed-a520-4003-9f1a-57c72c316219": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["2ec5f0ed-a520-4003-9f1a-57c72c316219"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=2ec5f0ed-a520-4003-9f1a-57c72c316219,limits=SchedulerLimits,nodename='n-h2-821350-1',service_host='n-h2-821350-1')] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:57:20.577787 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:57:20.616426 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:20.617556 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:20.681573 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:20.682065 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:20.682937 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:20.683391 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:20.703237 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:57:20.711303 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for user f658a868c72a4ef68bcaa6dd48b642f6 and project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:57:20.728324 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 9b405fa4-2d6e-42bd-addf-72776b651199] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:57:20.729602 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:20.730217 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:20.739303 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 9b405fa4-2d6e-42bd-addf-72776b651199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:57:20.741130 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:20.741994 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:20.779992 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:20.780448 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-73f6d302-a118-4f94-9d1a-6f28c1330b72 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:11.673518 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:58:12.691262 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47428. Dec 16 19:58:25.590845 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:58:26.627890 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47456. Dec 16 19:58:39.445053 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:58:54.912709 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:58:55.930434 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47512. Dec 16 19:59:01.550290 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:59:02.567827 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47526. Dec 16 19:59:07.592673 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-70fe5269-f2e2-4a36-ae96-a4d0ace71f6f tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:59:07.593311 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-70fe5269-f2e2-4a36-ae96-a4d0ace71f6f tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:07.593539 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-70fe5269-f2e2-4a36-ae96-a4d0ace71f6f tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:07.844782 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-70fe5269-f2e2-4a36-ae96-a4d0ace71f6f tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 9b405fa4-2d6e-42bd-addf-72776b651199] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89822) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:59:08.224744 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-70fe5269-f2e2-4a36-ae96-a4d0ace71f6f tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Created allocations for migration 9ab753b9-b936-42fa-9f0b-f1f548abcc5b on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:59:08.439651 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-70fe5269-f2e2-4a36-ae96-a4d0ace71f6f tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 9b405fa4-2d6e-42bd-addf-72776b651199] Calling prep_resize with selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"f3e8aa33-a634-4f3a-8683-94d69edc9cc6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["f3e8aa33-a634-4f3a-8683-94d69edc9cc6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=f3e8aa33-a634-4f3a-8683-94d69edc9cc6,limits=SchedulerLimits,nodename='n-h1-821350-1',service_host='n-h1-821350-1')] {{(pid=89822) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:59:09.713025 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:59:39.143971 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:59:39.168647 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:39.169052 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:39.217259 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:39.217717 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:39.218423 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:39.218810 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:39.235244 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:59:39.239950 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for user f658a868c72a4ef68bcaa6dd48b642f6 and project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:59:39.250604 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 75183778-3af7-4174-9995-6bb6b74d4611] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:59:39.251544 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:39.251938 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:39.258708 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 75183778-3af7-4174-9995-6bb6b74d4611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:59:39.259919 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:39.260312 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:39.292200 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:39.292597 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ba369bc4-a16f-4eb8-a952-2b31b62e0655 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:12.693068 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:01:13.709061 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47852. Dec 16 20:01:26.708316 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:27.729687 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47880. Dec 16 20:01:43.736324 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:01:45.586749 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:01:55.931924 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:56.947609 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47940. Dec 16 20:01:59.471809 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:02:02.568739 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:02:03.584717 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47956. Dec 16 20:02:07.643498 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:02:08.661439 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 47968. Dec 16 20:02:26.612050 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:02:27.636106 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48014. Dec 16 20:02:29.733816 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:02:32.261050 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-72403b5a-3bb2-4543-ac3f-cdeb56004157 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:02:32.262181 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-72403b5a-3bb2-4543-ac3f-cdeb56004157 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:32.262429 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-72403b5a-3bb2-4543-ac3f-cdeb56004157 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:02:32.412878 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-72403b5a-3bb2-4543-ac3f-cdeb56004157 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 75183778-3af7-4174-9995-6bb6b74d4611] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89822) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:02:32.694839 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-72403b5a-3bb2-4543-ac3f-cdeb56004157 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Created allocations for migration ade60b2d-dfe6-4baa-8965-9140aec2a818 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:02:33.035996 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-72403b5a-3bb2-4543-ac3f-cdeb56004157 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 75183778-3af7-4174-9995-6bb6b74d4611] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"2ec5f0ed-a520-4003-9f1a-57c72c316219": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["2ec5f0ed-a520-4003-9f1a-57c72c316219"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=2ec5f0ed-a520-4003-9f1a-57c72c316219,limits=SchedulerLimits,nodename='n-h2-821350-1',service_host='n-h2-821350-1')] {{(pid=89822) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:02:53.603735 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:02:53.627189 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:53.627611 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:02:53.673496 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:53.673885 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:02:53.674656 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:53.675044 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:02:53.690778 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:02:53.695295 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for user f658a868c72a4ef68bcaa6dd48b642f6 and project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:02:53.706404 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 156ced28-faa1-4352-8d3c-27d27455bdd5] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:02:53.707312 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:53.707709 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:02:53.714571 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 156ced28-faa1-4352-8d3c-27d27455bdd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:02:53.715817 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:53.716209 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:02:53.744611 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:02:53.745019 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-0d27f094-b301-42ff-a190-22a549f1b181 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:04:13.710050 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:04:14.725958 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48300. Dec 16 20:04:43.126872 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-845d2596-912d-4adc-a5b8-8262bea27ee0 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:04:43.127480 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-845d2596-912d-4adc-a5b8-8262bea27ee0 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:04:43.127736 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-845d2596-912d-4adc-a5b8-8262bea27ee0 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:04:43.308738 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-845d2596-912d-4adc-a5b8-8262bea27ee0 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 156ced28-faa1-4352-8d3c-27d27455bdd5] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89822) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:04:43.614667 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-845d2596-912d-4adc-a5b8-8262bea27ee0 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Created allocations for migration f88d7e0d-f891-449e-a30e-8aeac02b2f55 on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89822) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:04:43.814217 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.tasks.migrate [None req-845d2596-912d-4adc-a5b8-8262bea27ee0 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: 156ced28-faa1-4352-8d3c-27d27455bdd5] Calling prep_resize with selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"f3e8aa33-a634-4f3a-8683-94d69edc9cc6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["f3e8aa33-a634-4f3a-8683-94d69edc9cc6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=f3e8aa33-a634-4f3a-8683-94d69edc9cc6,limits=SchedulerLimits,nodename='n-h1-821350-1',service_host='n-h1-821350-1')] {{(pid=89822) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:04:56.949379 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:04:57.967119 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48410. Dec 16 20:05:03.587006 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:05:04.605913 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48432. Dec 16 20:05:18.407693 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:05:18.429965 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:05:18.430380 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:05:18.473277 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:05:18.473589 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:05:18.474350 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:05:18.474731 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:05:18.492143 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:05:18.496461 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Getting quotas for user f658a868c72a4ef68bcaa6dd48b642f6 and project 1979d7ebfddb48b59b5a5200dcc5886a. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:05:18.508139 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: e3dbc2e4-729f-4100-b4a4-f5e68b4f46ba] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:05:18.509064 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:05:18.509451 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:05:18.516814 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: e3dbc2e4-729f-4100-b4a4-f5e68b4f46ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:05:18.518136 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:05:18.518554 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:05:18.554514 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:05:18.554906 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-1aaa642c-8403-4281-8da6-f1d5cbeeecb7 tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:05:19.493676 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:05:49.754970 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:06:43.763627 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:06:45.607276 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:07:08.664153 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:07:09.680141 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48718. Dec 16 20:07:14.727187 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:07:15.742122 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48732. Dec 16 20:07:27.632306 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:07:27.729072 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:07:28.653062 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48762. Dec 16 20:07:28.750424 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48764. Dec 16 20:07:57.967872 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:07:58.984135 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48826. Dec 16 20:08:04.606079 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:08:05.622346 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48858. Dec 16 20:08:09.980512 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:08:11.435143 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:08:11.435807 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:11.435997 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:11.707515 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: e3dbc2e4-729f-4100-b4a4-f5e68b4f46ba] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:08:12.046929 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] Created allocations for migration 1aca21e4-cd16-430b-b247-22cf197d92b8 on 2ec5f0ed-a520-4003-9f1a-57c72c316219 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:08:12.446422 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [instance: e3dbc2e4-729f-4100-b4a4-f5e68b4f46ba] Calling prep_resize with selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"2ec5f0ed-a520-4003-9f1a-57c72c316219": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["2ec5f0ed-a520-4003-9f1a-57c72c316219"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=2ec5f0ed-a520-4003-9f1a-57c72c316219,limits=SchedulerLimits,nodename='n-h2-821350-1',service_host='n-h2-821350-1')] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:08:12.456678 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:08:13.472729 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [None req-8df7362a-8ca7-41e3-aeee-adbd5ef876ef tempest-ServerActionsTestJSON-87312339 tempest-ServerActionsTestJSON-87312339-project] [1e2b4177-5e1c-4106-b42a-adfda67cdcad] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 48908. Dec 16 20:08:39.516387 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:09:09.775503 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:09:18.487779 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:09:18.509705 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:18.510113 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:18.558416 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:18.558819 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:18.559545 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:18.559938 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:18.575440 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Getting quotas for project a24e6160ce5649908e2c1d737cc30e61. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:09:18.580352 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Getting quotas for user 02d5a24815194551907c07d203f45318 and project a24e6160ce5649908e2c1d737cc30e61. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:09:18.590848 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] [instance: b14c026e-6a18-4272-9e53-ce16450089a1] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:09:18.591761 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:18.592165 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:18.599208 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] [instance: b14c026e-6a18-4272-9e53-ce16450089a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:09:18.600601 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:18.601104 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:18.628252 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:18.628734 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-35a43e8a-4c96-4c7d-ad01-5c26c641ec18 tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:31.109548 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:09:31.133722 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:31.134246 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:31.190944 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:31.190944 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:31.190944 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:31.190944 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:31.205651 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Getting quotas for project a24e6160ce5649908e2c1d737cc30e61. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:09:31.210054 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Getting quotas for user 02d5a24815194551907c07d203f45318 and project a24e6160ce5649908e2c1d737cc30e61. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:09:31.221105 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] [instance: cf12692f-e893-4a78-9608-18cdb664843e] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:09:31.222028 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:31.222446 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:31.228423 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] [instance: cf12692f-e893-4a78-9608-18cdb664843e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:09:31.229604 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:31.229997 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:31.255447 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:31.255850 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-8ce1a643-fd99-4751-8a50-fc2d3eda54fe tempest-ServersNegativeTestJSON-409145338 tempest-ServersNegativeTestJSON-409145338-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:15.744267 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:10:16.761371 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 49530. Dec 16 20:10:30.199781 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:10:30.222671 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:10:30.223065 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:30.271215 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:10:30.271605 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:30.272313 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:10:30.272694 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:30.287480 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Getting quotas for project b4d782a789224696a9958e23e21598e9. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:10:30.291991 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Getting quotas for user 8483928745724908806e3596b77c6cd5 and project b4d782a789224696a9958e23e21598e9. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:10:30.303364 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] [instance: 0bd13e42-9188-4a39-a5f8-e9f1c7d50832] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:10:30.304277 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:10:30.304993 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:30.311520 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] [instance: 0bd13e42-9188-4a39-a5f8-e9f1c7d50832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:10:30.312790 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:10:30.313204 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:30.340522 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:10:30.340926 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-60062d07-28f7-4067-aa0e-15819c0b2a45 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:02.570375 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:11:02.592508 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:11:02.592901 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:02.636174 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:11:02.636490 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:02.637207 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:11:02.637593 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:02.652549 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Getting quotas for project b4d782a789224696a9958e23e21598e9. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:11:02.656890 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Getting quotas for user 8483928745724908806e3596b77c6cd5 and project b4d782a789224696a9958e23e21598e9. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:11:02.667470 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] [instance: 4c725bd9-f82b-46e4-b50e-a0848d32ea6d] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:11:02.668356 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:11:02.668744 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:02.675166 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] [instance: 4c725bd9-f82b-46e4-b50e-a0848d32ea6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:11:02.676482 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:11:02.676878 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:02.702206 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:11:02.702605 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ab9804ca-c842-4816-bfb1-ec2d1d1a44e2 tempest-TestEncryptedCinderVolumes-1021220916 tempest-TestEncryptedCinderVolumes-1021220916-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:11:05.623036 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:11:06.641744 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 49746. Dec 16 20:11:59.536695 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:12:11.916726 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:12:11.939477 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:11.939792 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:12.008743 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:12.009421 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:12.010643 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:12.011339 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:12.037599 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Getting quotas for project 55626025baba45f8a61f97e3e8f7a589. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:12:12.045548 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Getting quotas for user f35a17f77ab64ef4a02b13cdc46eb368 and project 55626025baba45f8a61f97e3e8f7a589. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:12:12.062634 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] [instance: cdb5d235-0923-463a-b051-f9ee3c619330] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:12:12.064169 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:12.064837 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:12.073333 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] [instance: cdb5d235-0923-463a-b051-f9ee3c619330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='daa33fd8-5438-4fb3-97ce-891f7b65394c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:12:12.074767 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:12.075166 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:12.102563 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:12.102965 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-b95bd603-418c-46fb-856b-cd75ead2a56b tempest-TestMinimumBasicScenario-1752363349 tempest-TestMinimumBasicScenario-1752363349-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:29.797707 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:13:10.006855 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:13:13.494433 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:13:16.760947 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:13:17.776756 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50222. Dec 16 20:13:28.652078 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:13:29.673650 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50228. Dec 16 20:13:58.988558 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:14:00.013044 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50262. Dec 16 20:14:06.642088 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:14:07.658323 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50264. Dec 16 20:14:28.751095 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:14:29.773071 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50268. Dec 16 20:15:03.798957 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:15:05.634922 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:15:09.686183 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:15:10.702354 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50392. Dec 16 20:15:19.557849 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:15:33.274703 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:15:33.298144 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:33.298573 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:33.348437 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:33.348829 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:33.349540 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:33.349913 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:33.365061 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:15:33.369635 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for user e266d8dbd57e45a4837dc83eaeb3cdd9 and project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:15:33.382574 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 0e3bfea4-2b6f-42ee-b30c-4be699d95154] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:15:33.383521 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:33.383906 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:33.391173 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 0e3bfea4-2b6f-42ee-b30c-4be699d95154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:15:33.393000 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:33.393505 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:33.423784 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:33.424264 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-3a44e69e-9971-424a-99e5-673a37b09aca tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:49.818872 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:16:17.778285 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:16:18.794326 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50666. Dec 16 20:16:39.683789 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:16:39.705918 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:39.706974 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:39.751222 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:39.751624 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:39.752345 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:39.752734 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:39.767453 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:16:39.772368 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for user e266d8dbd57e45a4837dc83eaeb3cdd9 and project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:16:39.782612 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: fd53f048-0341-4646-b23c-83deee140202] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:16:39.783542 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:39.783941 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:39.791336 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: fd53f048-0341-4646-b23c-83deee140202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:16:39.792613 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:39.793014 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:39.821231 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:39.821633 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-7e2b01cf-2aa0-472a-a7b3-546d761d0161 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:17:07.658128 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:17:08.673787 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50862. Dec 16 20:18:00.014164 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:18:01.030451 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50890. Dec 16 20:18:10.032876 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:18:13.515958 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:18:29.671237 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:18:30.691701 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 50920. Dec 16 20:18:39.580783 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:19:09.839839 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:19:10.703974 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:19:11.720627 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51026. Dec 16 20:19:18.795879 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:19:19.706064 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:19:19.730677 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:19.731176 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:19:19.783224 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:19.783622 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:19:19.784363 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:19.784748 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:19:19.799965 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:19:19.804577 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for user e266d8dbd57e45a4837dc83eaeb3cdd9 and project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:19:19.815164 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51068. Dec 16 20:19:19.815725 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 19a1718b-cb73-4d48-af73-6871ec41de90] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:19:19.816397 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:19.816800 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:19:19.824512 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 19a1718b-cb73-4d48-af73-6871ec41de90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:19:19.825117 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:19.825512 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:19:19.854684 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:19.855188 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-d7fcb116-18e9-4f66-9177-dccbb986e494 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:20:01.776324 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-ce2c3ac5-48f0-437e-a27a-221aa0946c1a tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method migrate_server {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:20:01.776900 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ce2c3ac5-48f0-437e-a27a-221aa0946c1a tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:20:01.777226 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-ce2c3ac5-48f0-437e-a27a-221aa0946c1a tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:20:02.005000 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-ce2c3ac5-48f0-437e-a27a-221aa0946c1a tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 19a1718b-cb73-4d48-af73-6871ec41de90] Restricting to cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) while migrating {{(pid=89821) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:20:02.336725 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-ce2c3ac5-48f0-437e-a27a-221aa0946c1a tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Created allocations for migration 12485ccc-caff-45a2-b984-49e659af365f on f3e8aa33-a634-4f3a-8683-94d69edc9cc6 {{(pid=89821) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:20:02.537895 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.tasks.migrate [None req-ce2c3ac5-48f0-437e-a27a-221aa0946c1a tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 19a1718b-cb73-4d48-af73-6871ec41de90] Calling prep_resize with selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [Selection(allocation_request='{"allocations": {"f3e8aa33-a634-4f3a-8683-94d69edc9cc6": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["f3e8aa33-a634-4f3a-8683-94d69edc9cc6"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=90b81751-9582-48d9-8edf-7fb85a52b7f1,compute_node_uuid=f3e8aa33-a634-4f3a-8683-94d69edc9cc6,limits=SchedulerLimits,nodename='n-h1-821350-1',service_host='n-h1-821350-1')] {{(pid=89821) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:20:08.675377 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:20:09.692316 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51178. Dec 16 20:21:29.774522 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:21:30.702733 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:21:30.727394 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:21:30.727788 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:21:30.772253 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:21:30.772643 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:21:30.773349 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:21:30.773887 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:21:30.797540 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51360. Dec 16 20:21:30.799205 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:21:30.804591 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for user e266d8dbd57e45a4837dc83eaeb3cdd9 and project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:21:30.815748 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 53b97c3a-c6be-4b49-b314-cfd51ff0350c] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:21:30.816691 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:21:30.817089 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:21:30.823455 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 53b97c3a-c6be-4b49-b314-cfd51ff0350c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:21:30.824634 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:21:30.825036 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:21:30.854872 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:21:30.855060 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-863a6749-f7b2-4beb-b5d7-e84f1042dd18 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:21:59.598825 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:22:11.721088 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:22:12.737596 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51426. Dec 16 20:22:19.815680 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:22:20.832024 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51434. Dec 16 20:22:29.859326 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:23:09.693389 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:23:10.709669 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51492. Dec 16 20:23:30.690113 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:23:31.711826 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51494. Dec 16 20:24:01.035421 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:24:02.051444 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51532. Dec 16 20:24:16.628229 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [345e7d38-c653-45bb-989b-d9adb2900314] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:24:17.644128 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [345e7d38-c653-45bb-989b-d9adb2900314] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51624. Dec 16 20:24:20.043628 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Took 3.42 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:24:20.068313 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:24:20.068880 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:24:20.117628 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:24:20.118027 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:24:20.118922 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:24:20.119313 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:24:20.135302 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:24:20.139874 n-d-821350-1 nova-conductor[89822]: DEBUG nova.quota [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Getting quotas for user e266d8dbd57e45a4837dc83eaeb3cdd9 and project 1444b05289834010903e996cf0c7dbb7. Resources: {'instances', 'ram', 'cores'} {{(pid=89822) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:24:20.150596 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 4fca8821-2a96-492a-9a2b-c0fede0e4cf0] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89822) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:24:20.151539 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:24:20.151937 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:24:20.159893 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [instance: 4fca8821-2a96-492a-9a2b-c0fede0e4cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89822) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:24:20.161106 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:24:20.161501 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:24:20.188802 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:24:20.189260 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:24:20.200326 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [6ba6f4b1-8697-49ff-83a4-0d0a8c193279] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:24:21.216481 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [None req-906a3db2-7c10-4170-aea5-2df67ec82d55 tempest-TestNetworkAdvancedServerOps-322212392 tempest-TestNetworkAdvancedServerOps-322212392-project] [6ba6f4b1-8697-49ff-83a4-0d0a8c193279] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51650. Dec 16 20:24:50.059751 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:25:19.622634 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:25:20.833059 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:25:21.849178 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 51782. Dec 16 20:25:41.646420 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:25:41.671824 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:25:41.672224 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:25:41.721848 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:25:41.722330 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:25:41.723049 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:25:41.723434 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:25:41.738795 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Getting quotas for project d1a8fc04263e4b828ae6f08b4cfc73b6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:25:41.743611 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Getting quotas for user 5cadc267895640a0915aaa111aff38a6 and project d1a8fc04263e4b828ae6f08b4cfc73b6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:25:41.754387 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] [instance: 0be95bd8-4e8f-454f-a061-9ba851258ac9] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:25:41.755279 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:25:41.755670 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:25:41.767297 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] [instance: 0be95bd8-4e8f-454f-a061-9ba851258ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:25:41.768484 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:25:41.768874 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:25:41.795286 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:25:41.795675 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c925e285-244e-43e6-8509-faca8bdb5de0 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:25:49.880306 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:26:10.709772 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:26:11.727001 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52000. Dec 16 20:26:30.800056 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:26:31.822758 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52008. Dec 16 20:27:12.740088 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:27:13.756119 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52030. Dec 16 20:28:02.054095 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:28:03.069831 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52036. Dec 16 20:28:10.083441 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:28:13.554466 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:28:21.849903 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:28:22.864820 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52062. Dec 16 20:28:31.716221 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:28:32.737595 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52090. Dec 16 20:28:39.648489 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:28:52.304724 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-619e6e7a-5c40-40da-b235-f564ca4616ca tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method unshelve_instance {{(pid=89822) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:28:52.306697 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-619e6e7a-5c40-40da-b235-f564ca4616ca tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:28:52.308828 n-d-821350-1 nova-conductor[89822]: DEBUG oslo_concurrency.lockutils [None req-619e6e7a-5c40-40da-b235-f564ca4616ca tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:28:52.602939 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-619e6e7a-5c40-40da-b235-f564ca4616ca tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] [instance: 0be95bd8-4e8f-454f-a061-9ba851258ac9] Requesting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) during scheduling {{(pid=89822) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 20:28:52.950705 n-d-821350-1 nova-conductor[89822]: DEBUG nova.conductor.manager [None req-619e6e7a-5c40-40da-b235-f564ca4616ca tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89822) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:29:09.903547 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:29:11.727179 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:29:12.742894 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52242. Dec 16 20:30:48.787235 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Took 0.35 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:30:48.808881 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:30:48.809281 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:30:48.851157 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:30:48.851552 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:30:48.852271 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:30:48.852657 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:30:48.867843 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Getting quotas for project d1a8fc04263e4b828ae6f08b4cfc73b6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:30:48.872200 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Getting quotas for user 5cadc267895640a0915aaa111aff38a6 and project d1a8fc04263e4b828ae6f08b4cfc73b6. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:30:48.883364 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] [instance: fca5c639-5540-42ad-a94d-99893ca4543f] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:30:48.884271 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:30:48.884668 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:30:48.892400 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] [instance: fca5c639-5540-42ad-a94d-99893ca4543f] block_device_mapping [BlockDeviceMapping(attachment_id=e9de61a4-4bb5-4d4d-8fbe-e1633cd00787,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ca6cc06-b551-4e80-98f9-69ed9a083523',volume_size=1,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:30:48.893614 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:30:48.894010 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:30:48.920690 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:30:48.921169 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-a0d1718d-e515-4c66-9172-36c93d1cef8b tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:31:13.758038 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:31:14.774472 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52518. Dec 16 20:31:22.866163 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:31:23.881961 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52522. Dec 16 20:31:31.820144 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:31:32.842875 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52534. Dec 16 20:31:43.850791 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:31:45.681370 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:31:59.672778 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:32:12.743929 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:32:13.759799 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52552. Dec 16 20:32:29.924536 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:33:03.073116 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:33:04.088876 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52562. Dec 16 20:33:10.106565 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:33:13.578908 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:33:19.905529 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c901b28f-c0f4-406b-b1cc-a63c27029bb6 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Targeting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) for conductor method unshelve_instance {{(pid=89821) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:33:19.906270 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c901b28f-c0f4-406b-b1cc-a63c27029bb6 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:33:19.906707 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-c901b28f-c0f4-406b-b1cc-a63c27029bb6 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:33:20.129971 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c901b28f-c0f4-406b-b1cc-a63c27029bb6 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] [instance: fca5c639-5540-42ad-a94d-99893ca4543f] Requesting cell 90b81751-9582-48d9-8edf-7fb85a52b7f1(cell1) during scheduling {{(pid=89821) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 20:33:20.569268 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-c901b28f-c0f4-406b-b1cc-a63c27029bb6 tempest-TestShelveInstance-2141796673 tempest-TestShelveInstance-2141796673-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:34:14.775188 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:34:15.792212 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52670. Dec 16 20:34:23.883062 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:34:24.899424 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52672. Dec 16 20:34:32.839244 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:34:33.860456 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52680. Dec 16 20:35:03.870905 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:35:05.702814 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:35:13.761815 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:35:14.779764 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 52776. Dec 16 20:35:19.695109 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:35:32.166670 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:35:32.189251 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:35:32.189652 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:35:32.238395 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:35:32.238799 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:35:32.239514 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:35:32.239897 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:35:32.256774 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Getting quotas for project 81497ba1f49a4671a76cb17f19e3c146. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:35:32.261143 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Getting quotas for user 9e6b44857c844cbaae82a881e1f594b0 and project 81497ba1f49a4671a76cb17f19e3c146. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:35:32.272132 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] [instance: 7c25c2c5-ae16-44fc-8b6d-dd448ef1d88a] Selected host: n-h2-821350-1; Selected node: n-h2-821350-1; Alternates: [('n-h1-821350-1', 'n-h1-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:35:32.273040 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:35:32.273454 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:35:32.279961 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] [instance: 7c25c2c5-ae16-44fc-8b6d-dd448ef1d88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6e6c56-6bdf-4d52-95e2-458bb3fd8684',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:35:32.281758 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:35:32.282140 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:35:32.308956 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:35:32.309351 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-11ee6e18-cb79-4c5c-bd34-5cb42145cc6d tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:35:49.942997 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:37:15.793132 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:37:16.808713 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53014. Dec 16 20:37:24.901889 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:37:25.918090 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53018. Dec 16 20:37:32.739876 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:37:33.760738 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53022. Dec 16 20:37:33.856232 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:37:34.876858 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53024. Dec 16 20:38:04.093234 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:38:05.108775 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53026. Dec 16 20:38:10.133186 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:38:13.601979 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:38:14.779914 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:38:15.796719 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53056. Dec 16 20:38:23.890829 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:38:25.723560 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:38:34.165014 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89821) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:38:34.188322 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:34.188728 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:34.259036 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:34.259507 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:34.260387 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:34.260911 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:34.278525 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Getting quotas for project 81497ba1f49a4671a76cb17f19e3c146. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:38:34.283478 n-d-821350-1 nova-conductor[89821]: DEBUG nova.quota [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Getting quotas for user 9e6b44857c844cbaae82a881e1f594b0 and project 81497ba1f49a4671a76cb17f19e3c146. Resources: {'instances', 'ram', 'cores'} {{(pid=89821) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:38:34.295306 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] [instance: 3da97e2f-47f6-48be-b2ee-de0c30cbc826] Selected host: n-h1-821350-1; Selected node: n-h1-821350-1; Alternates: [('n-h2-821350-1', 'n-h2-821350-1')] {{(pid=89821) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:38:34.296244 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:34.296639 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:34.303655 n-d-821350-1 nova-conductor[89821]: DEBUG nova.conductor.manager [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] [instance: 3da97e2f-47f6-48be-b2ee-de0c30cbc826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d1a27827-b7e4-48e0-bf45-cc00c8df2115',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89821) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:38:34.304861 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:34.305258 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:34.351303 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:34.351992 n-d-821350-1 nova-conductor[89821]: DEBUG oslo_concurrency.lockutils [None req-facd02dc-ab8a-43e7-8fcc-975547ab3267 tempest-TestSnapshotPattern-1683244217 tempest-TestSnapshotPattern-1683244217-project] Lock "90b81751-9582-48d9-8edf-7fb85a52b7f1" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:39.724668 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:39:09.964948 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:40:16.809921 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:40:17.826161 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53284. Dec 16 20:40:25.919767 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:40:26.940326 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53330. Dec 16 20:40:33.757174 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:40:34.782449 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53404. Dec 16 20:40:34.874573 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:40:35.915154 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53414. Dec 16 20:41:05.110832 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:41:06.136475 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53550. Dec 16 20:41:15.798067 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:41:16.814297 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53552. Dec 16 20:41:30.155025 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:41:33.622955 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:41:43.922874 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:41:45.748885 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:41:59.746388 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:42:29.986166 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:43:17.827303 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:43:18.843937 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53578. Dec 16 20:43:26.940965 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:43:27.958251 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53580. Dec 16 20:43:34.775724 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:43:35.798762 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53582. Dec 16 20:43:35.901310 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:43:36.923015 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53584. Dec 16 20:44:06.136094 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:44:07.152708 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53592. Dec 16 20:44:16.814850 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:44:17.831077 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53594. Dec 16 20:44:50.174364 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:44:53.645869 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:45:03.942171 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:45:05.768893 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:45:19.767670 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:45:50.007998 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:46:18.845644 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:46:19.863344 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53630. Dec 16 20:46:27.958837 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:46:28.974079 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53634. Dec 16 20:46:35.793202 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:46:36.813270 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bbe22c-f2ba-4316-ba1c-c696bc96bd81] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53640. Dec 16 20:46:36.918924 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:46:37.941935 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [6143fc7c-1032-4e35-af29-3e9749b844d5] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53642. Dec 16 20:47:07.154248 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] AMQP server on 10.222.0.31:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:47:08.170562 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [e877aa97-df33-41ec-a4a5-698fab940cf7] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53646. Dec 16 20:47:17.831963 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:47:18.849511 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [1af49069-15af-423a-bcea-2ac60aeb79fb] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53650. Dec 16 20:48:10.194436 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:48:13.670199 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:48:23.962935 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:48:25.788584 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:48:39.786863 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:49:10.025954 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:49:19.864385 n-d-821350-1 nova-conductor[89822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:49:20.880305 n-d-821350-1 nova-conductor[89822]: INFO oslo.messaging._drivers.impl_rabbit [-] [a8f5086b-e363-442f-b937-8cc97200f05b] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53682. Dec 16 20:49:28.975708 n-d-821350-1 nova-conductor[89821]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] AMQP server on 10.222.0.31:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:49:29.992252 n-d-821350-1 nova-conductor[89821]: INFO oslo.messaging._drivers.impl_rabbit [-] [f50d31f2-b0e5-4781-b1b8-14597b82a95d] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 53684.